Jun 13 00:55:26.375475 ip-10-0-140-23 systemd[1]: Starting Kubernetes Kubelet... Jun 13 00:55:26.731199 ip-10-0-140-23 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:55:26.731199 ip-10-0-140-23 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 00:55:26.731199 ip-10-0-140-23 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:55:26.731199 ip-10-0-140-23 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 00:55:26.731199 ip-10-0-140-23 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:55:26.733066 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.732982 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 00:55:26.737125 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737110 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737127 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737131 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737135 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737139 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737144 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737147 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737150 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737153 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737156 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737159 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737161 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737176 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.737179 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737182 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737186 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737191 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737195 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737198 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737201 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737204 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737207 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737210 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737213 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737216 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737218 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737221 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737223 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737226 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737228 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737231 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737235 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737238 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.737495 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737241 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737244 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737246 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737249 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737252 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737254 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737257 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737260 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737263 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737265 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737269 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737272 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737274 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737276 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737279 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737282 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737285 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737287 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737290 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.737946 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737292 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737295 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737298 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737301 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737304 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737306 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737308 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737311 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737313 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737316 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737318 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737320 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737323 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737325 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737328 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737332 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737335 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737338 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737340 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.738432 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737342 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737345 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737348 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737351 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737354 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737356 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737359 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737361 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737364 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737367 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737370 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737373 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737375 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737378 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737381 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737383 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737385 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737389 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737393 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737395 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.738896 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737397 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737400 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737403 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737405 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737407 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737410 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737413 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737416 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.737419 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738125 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738132 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738135 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738138 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738142 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738145 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738148 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738151 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738154 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738156 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738159 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.739413 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738161 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738179 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738183 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738185 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738188 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738191 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738193 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738196 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738198 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738201 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738204 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738207 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738209 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738212 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738214 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738217 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738220 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738223 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738225 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738227 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.739894 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738230 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738233 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738236 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738239 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738242 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738244 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738249 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738253 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738256 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738259 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738262 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738264 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738267 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738269 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738272 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738274 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738277 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738280 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738282 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.740417 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738284 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738287 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738290 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738293 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738296 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738298 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738300 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738303 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738306 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738308 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738311 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738314 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738317 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738320 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738322 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738325 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738328 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738332 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738336 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.740889 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738339 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738342 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738344 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738347 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738350 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738353 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738356 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738359 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738362 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738366 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738369 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738371 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738374 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738376 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738379 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738381 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738384 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738386 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738389 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738392 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.741361 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738394 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738397 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738399 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738402 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738405 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738408 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738410 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738413 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738416 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738418 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738766 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738771 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738773 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738776 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738779 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738781 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738784 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738786 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738789 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738792 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.741853 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738795 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738797 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738800 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738802 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738805 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738807 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738810 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738812 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738815 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738817 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738820 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738823 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738825 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738827 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738831 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738834 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738837 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738840 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738842 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.742445 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738855 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738860 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738863 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738866 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738871 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738874 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738877 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738880 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738883 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738886 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738888 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738891 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738894 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738896 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738899 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738902 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738905 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738907 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738910 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738912 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.742921 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738915 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738917 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738920 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738922 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738925 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738928 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738930 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738933 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738937 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738939 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738942 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738945 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738947 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738950 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738953 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738955 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738960 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738963 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738967 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.743441 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738970 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738973 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738976 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738979 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738982 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738985 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738987 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738990 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738992 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738995 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738997 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.738999 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739002 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739005 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739007 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739009 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739012 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739014 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739017 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739020 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.743944 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739022 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739025 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739027 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739030 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739033 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739035 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739038 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739040 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739043 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739048 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739050 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739140 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739151 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739158 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739162 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739181 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739186 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739192 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739197 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739200 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739203 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 00:55:26.744448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739206 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739210 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739213 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739216 2558 flags.go:64] FLAG: --cgroup-root="" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739219 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739222 2558 flags.go:64] FLAG: --client-ca-file="" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739225 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739228 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739233 2558 flags.go:64] FLAG: --cluster-domain="" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739235 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739239 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739242 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739246 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739249 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739256 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739259 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739262 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739265 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739268 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739271 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739275 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739279 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739283 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739286 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739289 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 00:55:26.744967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739292 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739295 2558 flags.go:64] FLAG: --enable-server="true" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739298 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739302 2558 flags.go:64] FLAG: --event-burst="100" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739305 2558 flags.go:64] FLAG: --event-qps="50" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739308 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739311 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739314 2558 flags.go:64] FLAG: --eviction-hard="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739318 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739321 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739324 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739327 2558 flags.go:64] FLAG: --eviction-soft="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739329 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739332 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739335 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739338 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739341 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739344 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739347 2558 flags.go:64] FLAG: --feature-gates="" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739351 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739354 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739358 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739362 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739365 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739368 2558 flags.go:64] FLAG: --help="false" Jun 13 00:55:26.745670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739371 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-140-23.ec2.internal" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739374 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739379 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739381 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739385 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739389 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739392 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739395 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739397 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739400 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739404 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739407 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739409 2558 flags.go:64] FLAG: --kube-reserved="" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739412 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739415 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739419 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739422 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739425 2558 flags.go:64] FLAG: --lock-file="" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739428 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739431 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739434 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739439 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739442 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739445 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 00:55:26.746525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739448 2558 flags.go:64] FLAG: --logging-format="text" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739451 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739455 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739457 2558 flags.go:64] FLAG: --manifest-url="" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739462 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739466 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739469 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739474 2558 flags.go:64] FLAG: --max-pods="110" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739477 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739480 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739484 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739487 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739490 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739493 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739496 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739502 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739505 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739508 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739511 2558 flags.go:64] FLAG: --pod-cidr="" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739514 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739519 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739522 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739526 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739529 2558 flags.go:64] FLAG: --port="10250" Jun 13 00:55:26.747344 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739532 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739534 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0518db7270b59405d" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739538 2558 flags.go:64] FLAG: --qos-reserved="" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739541 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739544 2558 flags.go:64] FLAG: --register-node="true" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739547 2558 flags.go:64] FLAG: --register-with-taints="" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739551 2558 flags.go:64] FLAG: --registry-burst="10" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739554 2558 flags.go:64] FLAG: --registry-qps="5" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739556 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739559 2558 flags.go:64] FLAG: --reserved-memory="" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739563 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739567 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739570 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739574 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739577 2558 flags.go:64] FLAG: --runonce="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739580 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739583 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739586 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739590 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739593 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739596 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739599 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739602 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739605 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739608 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 00:55:26.747934 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739611 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739614 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739617 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739620 2558 flags.go:64] FLAG: --system-cgroups="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739623 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739628 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739631 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739634 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739639 2558 flags.go:64] FLAG: --tls-min-version="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739642 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739644 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739647 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739649 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739652 2558 flags.go:64] FLAG: --v="2" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739656 2558 flags.go:64] FLAG: --version="false" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739659 2558 flags.go:64] FLAG: --vmodule="" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739663 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.739666 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739778 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739782 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739787 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739790 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739793 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.748548 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739796 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739798 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739802 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739805 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739807 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739810 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739812 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739815 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739817 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739820 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739823 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739825 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739828 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739830 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739833 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739836 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739838 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739842 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739846 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739849 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.749144 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739852 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739855 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739858 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739861 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739863 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739867 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739869 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739872 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739875 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739881 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739883 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739886 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739889 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739891 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739896 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739898 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739901 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739905 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739908 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.749658 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739910 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739913 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739916 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739918 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739921 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739924 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739926 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739929 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739931 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739934 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739937 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739939 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739942 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739944 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739947 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739949 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739952 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739955 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739957 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739960 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.750127 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739963 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739965 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739969 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739972 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739975 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739977 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739980 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739984 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739986 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739989 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739992 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739994 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739997 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.739999 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740002 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740004 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740007 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740009 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740012 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740015 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.750643 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740017 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740020 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740023 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740025 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740028 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740030 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740033 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740035 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740038 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740040 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740043 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740046 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740048 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740052 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.740056 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.751138 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.740062 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.749936 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.749965 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.750763 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.750771 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750900 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750906 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750910 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750914 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750917 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750920 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750924 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750935 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750939 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750945 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750948 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750951 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750954 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750957 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.751542 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750960 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750963 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750965 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750969 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750971 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750974 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750977 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750980 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750985 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750987 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750990 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750993 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750995 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.750998 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751001 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751005 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751008 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751011 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751014 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.752001 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751017 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751022 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751025 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751028 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751031 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751034 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751037 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751047 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751050 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751053 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751056 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751058 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751061 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751066 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751069 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751072 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751074 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751077 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751080 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751083 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.752484 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751085 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751088 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751091 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751093 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751096 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751098 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751103 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751106 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751110 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751113 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751116 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751118 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751121 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751124 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751127 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751129 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751132 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751135 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751137 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751142 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.752968 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751151 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751154 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751157 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751160 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751162 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751179 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751182 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751185 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751188 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751191 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751194 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751197 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751204 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751207 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751211 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751214 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751217 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751220 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751223 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.753632 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751227 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751230 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751234 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751236 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751240 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751247 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751250 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.751256 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751516 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751522 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751526 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751529 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751535 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751538 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751546 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:55:26.754087 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751549 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751552 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751555 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751558 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751561 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751563 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751566 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751569 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751571 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751576 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751579 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751583 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751585 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751588 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751591 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751599 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751602 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751605 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751608 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751611 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:55:26.754459 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751614 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751617 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751622 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751625 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751627 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751630 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751633 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751635 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751638 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751641 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751643 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751646 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751654 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751657 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751660 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751665 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751668 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751670 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751673 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751676 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:55:26.754984 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751678 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751681 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751683 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751686 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751689 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751692 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751695 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751697 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751702 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751705 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751709 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751713 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751716 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751719 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751722 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751725 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751728 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751730 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751733 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:55:26.755487 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751736 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751742 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751744 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751747 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751750 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751752 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751764 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751767 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751770 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751773 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751777 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751780 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751786 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751788 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751791 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751795 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751797 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751800 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751803 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751805 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:55:26.755962 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751808 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751811 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751814 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751817 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751819 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751824 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751827 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751830 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751833 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751835 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751838 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751841 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:26.751843 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.751848 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.752034 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 00:55:26.756529 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.755300 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 00:55:26.756895 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.756775 2558 server.go:1019] "Starting client certificate rotation" Jun 13 00:55:26.756895 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.756880 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:55:26.756950 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.756919 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:55:26.760138 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.760120 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:55:26.763359 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.763344 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:55:26.771283 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.771264 2558 log.go:25] "Validated CRI v1 runtime API" Jun 13 00:55:26.774148 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.774135 2558 log.go:25] "Validated CRI v1 image API" Jun 13 00:55:26.776091 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.776074 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 00:55:26.779036 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.779015 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b41bef09-4d11-4ab3-be5b-4acc1f423d39:/dev/nvme0n1p3 c8cb6bfb-354b-4117-90c6-090d142182d5:/dev/nvme0n1p4] Jun 13 00:55:26.779093 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.779036 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 00:55:26.785907 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.785790 2558 manager.go:216] Machine: {Timestamp:2026-06-13 00:55:26.783552537 +0000 UTC m=+0.294968337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096267 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a5618d5bf36c29a316e6b174023d SystemUUID:ec27a561-8d5b-f36c-29a3-16e6b174023d BootID:52e12660-449c-4e2c-9870-34b493ee183f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:67:73:5e:0f:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:67:73:5e:0f:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:a0:cb:5c:df:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 00:55:26.785907 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.785907 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 00:55:26.786014 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.785988 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 00:55:26.787893 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.787877 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:55:26.788990 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.788963 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 00:55:26.789151 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.788994 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 00:55:26.789642 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.789633 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 00:55:26.789681 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.789645 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 00:55:26.789681 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.789653 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:55:26.790386 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.790374 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:55:26.791541 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.791531 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 00:55:26.795155 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795143 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:55:26.795290 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795280 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 00:55:26.795320 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795309 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 13 00:55:26.795355 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795341 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 00:55:26.795385 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795360 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 00:55:26.795422 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795413 2558 kubelet.go:398] "Adding apiserver pod source" Jun 13 00:55:26.795454 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795429 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 00:55:26.795885 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795853 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:55:26.795885 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.795874 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:55:26.798450 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.798426 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 00:55:26.801723 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.801697 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 00:55:26.801973 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.801956 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 00:55:26.802252 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802240 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 00:55:26.802292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802257 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 00:55:26.802292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802263 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 00:55:26.802292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802268 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 00:55:26.802292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802276 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 00:55:26.802292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802281 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 00:55:26.802578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802570 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 00:55:26.802578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802578 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 00:55:26.802634 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802585 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 00:55:26.802634 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802591 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 00:55:26.802634 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802606 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 00:55:26.802634 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.802614 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 00:55:26.804023 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.804011 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 00:55:26.804023 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.804022 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 00:55:26.806007 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.805984 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 00:55:26.806076 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.806023 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 00:55:26.806076 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.806024 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 00:55:26.807378 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.807363 2558 server.go:1268] "Started kubelet" Jun 13 00:55:26.807460 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.807424 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 00:55:26.807981 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.807917 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 00:55:26.808051 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.807989 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 00:55:26.808211 ip-10-0-140-23 systemd[1]: Started Kubernetes Kubelet. Jun 13 00:55:26.809520 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.809504 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 13 00:55:26.809656 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.809640 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 00:55:26.813661 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.813642 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 00:55:26.813737 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.813661 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 00:55:26.813737 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.813722 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:26.813879 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.813824 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 00:55:26.814294 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814267 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 00:55:26.814294 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814277 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 00:55:26.814294 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814294 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 00:55:26.814510 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.813472 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df108725f0e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.80733467 +0000 UTC m=+0.318750469,LastTimestamp:2026-06-13 00:55:26.80733467 +0000 UTC m=+0.318750469,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.814510 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814399 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 13 00:55:26.814510 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814409 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 13 00:55:26.814797 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814768 2558 factory.go:153] Registering CRI-O factory Jun 13 00:55:26.814797 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814793 2558 factory.go:223] Registration of the crio container factory successfully Jun 13 00:55:26.814889 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814839 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 00:55:26.814889 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814847 2558 factory.go:55] Registering systemd factory Jun 13 00:55:26.814889 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814852 2558 factory.go:223] Registration of the systemd container factory successfully Jun 13 00:55:26.814889 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814869 2558 factory.go:103] Registering Raw factory Jun 13 00:55:26.814889 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.814878 2558 manager.go:1196] Started watching for new ooms in manager Jun 13 00:55:26.816011 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.815994 2558 manager.go:349] Starting recovery of all containers Jun 13 00:55:26.823981 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.823833 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 00:55:26.824321 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.824296 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 00:55:26.826015 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.825999 2558 manager.go:354] Recovery completed Jun 13 00:55:26.829921 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.829908 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.831688 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.831660 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.831764 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.831703 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.831764 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.831719 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.832232 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832216 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 00:55:26.832232 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832231 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 00:55:26.832370 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832246 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:55:26.832370 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832313 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.832920 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832905 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.832957 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832931 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.832957 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.832940 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.833342 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.833280 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df109e5f657 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.831687255 +0000 UTC m=+0.343103074,LastTimestamp:2026-06-13 00:55:26.831687255 +0000 UTC m=+0.343103074,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.834369 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.834357 2558 policy_none.go:49] "None policy: Start" Jun 13 00:55:26.834429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.834375 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 00:55:26.834429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.834388 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 00:55:26.836338 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.836326 2558 policy_none.go:47] "Start" Jun 13 00:55:26.842191 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.842123 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df109e653a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-23.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.831711136 +0000 UTC m=+0.343126937,LastTimestamp:2026-06-13 00:55:26.831711136 +0000 UTC m=+0.343126937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.845201 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.845184 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ckwtx" Jun 13 00:55:26.845997 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.845945 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df109e6880d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-23.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.831724557 +0000 UTC m=+0.343140362,LastTimestamp:2026-06-13 00:55:26.831724557 +0000 UTC m=+0.343140362,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.851342 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.851259 2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-23.ec2.internal.18b87df109e5f657\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df109e5f657 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.831687255 +0000 UTC m=+0.343103074,LastTimestamp:2026-06-13 00:55:26.832919837 +0000 UTC m=+0.344335638,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.853149 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.853097 2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-23.ec2.internal.18b87df109e653a0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-23.ec2.internal.18b87df109e653a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-23.ec2.internal,UID:ip-10-0-140-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-23.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-23.ec2.internal,},FirstTimestamp:2026-06-13 00:55:26.831711136 +0000 UTC m=+0.343126937,LastTimestamp:2026-06-13 00:55:26.832935659 +0000 UTC m=+0.344351458,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-23.ec2.internal,}" Jun 13 00:55:26.854279 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.854084 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ckwtx" Jun 13 00:55:26.867755 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.867743 2558 manager.go:337] "Starting Device Plugin manager" Jun 13 00:55:26.867844 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.867775 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 00:55:26.867844 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.867783 2558 server.go:87] "Starting device plugin registration server" Jun 13 00:55:26.867997 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.867983 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 00:55:26.868087 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.867998 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 00:55:26.868195 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.868182 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 00:55:26.868265 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.868251 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 00:55:26.868265 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.868260 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 00:55:26.868802 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.868785 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 00:55:26.868892 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.868835 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:26.881311 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.881291 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 00:55:26.898897 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.882453 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 00:55:26.898897 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.882492 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 00:55:26.898897 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.882509 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 00:55:26.898897 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.882539 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 00:55:26.898897 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.884925 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:26.968528 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.968483 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.969624 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.969607 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.969706 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.969635 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.969706 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.969645 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.969706 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.969668 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-23.ec2.internal" Jun 13 00:55:26.978253 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.978236 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-23.ec2.internal" Jun 13 00:55:26.978300 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:26.978256 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-23.ec2.internal\": node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:26.982806 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.982758 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal"] Jun 13 00:55:26.982868 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.982821 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.983515 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.983500 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.983559 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.983539 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.983559 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.983552 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.985767 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.985755 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.985893 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.985879 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:26.985929 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.985910 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.986891 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986875 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.986891 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986888 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.987017 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986901 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.987017 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986908 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.987017 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986911 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.987017 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.986919 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:26.989104 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.989088 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:26.989207 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.989111 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:26.989807 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.989792 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:26.989863 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.989820 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:26.989863 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:26.989837 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:27.010138 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.010120 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.011727 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.011713 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-23.ec2.internal\" not found" node="ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.015831 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.015813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.015916 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.015835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f341c26788f7c8a897d12eca4dbc7e0d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-23.ec2.internal\" (UID: \"f341c26788f7c8a897d12eca4dbc7e0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.015916 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.015847 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-23.ec2.internal\" not found" node="ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.015916 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.015853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.110493 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.110466 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.116981 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.116960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.117056 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.116988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.117056 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.117005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f341c26788f7c8a897d12eca4dbc7e0d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-23.ec2.internal\" (UID: \"f341c26788f7c8a897d12eca4dbc7e0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.117056 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.117032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f341c26788f7c8a897d12eca4dbc7e0d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-23.ec2.internal\" (UID: \"f341c26788f7c8a897d12eca4dbc7e0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.117056 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.117048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.117233 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.117067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c99c5d3a6d53cba96f16302874cc68f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal\" (UID: \"c99c5d3a6d53cba96f16302874cc68f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.211201 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.211143 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.311878 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.311851 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.313999 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.313986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.319113 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.319096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:27.412776 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.412743 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.513278 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.513248 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.613711 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.613644 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.631670 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.631650 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:27.663578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.663547 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:27.713817 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.713784 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.755897 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.755869 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 00:55:27.756446 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.756010 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 00:55:27.756446 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.756038 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 00:55:27.756446 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.756043 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 00:55:27.814656 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.814633 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.858743 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.858693 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 00:50:26 +0000 UTC" deadline="2028-01-12 06:53:23.117712966 +0000 UTC" Jun 13 00:55:27.858743 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.858733 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13877h57m55.25898311s" Jun 13 00:55:27.914974 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.914953 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:55:27.914974 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:27.914960 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:27.916479 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.916461 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:55:27.916575 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.916492 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:55:27.916575 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.916505 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:55:27.918696 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:27.918661 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf341c26788f7c8a897d12eca4dbc7e0d.slice/crio-0e8e2a5d22d1e6de1037adacb95ef2694e6b47c3e590653bb5c8b5298d15f277 WatchSource:0}: Error finding container 0e8e2a5d22d1e6de1037adacb95ef2694e6b47c3e590653bb5c8b5298d15f277: Status 404 returned error can't find the container with id 0e8e2a5d22d1e6de1037adacb95ef2694e6b47c3e590653bb5c8b5298d15f277 Jun 13 00:55:27.919286 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:27.919273 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99c5d3a6d53cba96f16302874cc68f6.slice/crio-da0df0d0062df648bf358b92d86f8cd1408ae6fa4646120de24bf698497850f1 WatchSource:0}: Error finding container da0df0d0062df648bf358b92d86f8cd1408ae6fa4646120de24bf698497850f1: Status 404 returned error can't find the container with id da0df0d0062df648bf358b92d86f8cd1408ae6fa4646120de24bf698497850f1 Jun 13 00:55:27.923848 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:27.923833 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 00:55:28.015311 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.015277 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:28.115764 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.115724 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:28.216225 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.216146 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:28.316928 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.316890 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-23.ec2.internal\" not found" Jun 13 00:55:28.356547 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.356520 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:28.414488 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.414243 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" Jun 13 00:55:28.427919 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.427801 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:55:28.428903 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.428875 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" Jun 13 00:55:28.438949 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.438926 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:55:28.749706 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.749680 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:28.796496 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.796469 2558 apiserver.go:52] "Watching apiserver" Jun 13 00:55:28.801681 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.801654 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 00:55:28.802117 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.802084 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-wkmk2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm","openshift-cluster-node-tuning-operator/tuned-2msz4","openshift-dns/node-resolver-kpjtl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal","openshift-multus/network-metrics-daemon-mrtvs","openshift-network-diagnostics/network-check-target-mq4cd","openshift-network-operator/iptables-alerter-fn5tw","openshift-ovn-kubernetes/ovnkube-node-cgfdp","kube-system/global-pull-secret-syncer-pvstp","kube-system/konnectivity-agent-cfh2n","kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal","openshift-image-registry/node-ca-w5m6t","openshift-multus/multus-additional-cni-plugins-bnsf9"] Jun 13 00:55:28.804982 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.804658 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:28.804982 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.804745 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:28.806870 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.806844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.809062 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.809039 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.811302 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.811281 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.813526 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.813502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.813627 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.813578 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:28.814724 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.814706 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 00:55:28.815660 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.815643 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.816295 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.816278 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 00:55:28.817817 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.817800 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:28.818546 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.818529 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.820818 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.820800 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.823412 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.823643 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.823850 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.823906 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.824060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-49jx9\"" Jun 13 00:55:28.825331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:28.825761 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.825403 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:28.825761 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825485 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.825761 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825502 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njlzd\"" Jun 13 00:55:28.825761 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:28.825761 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7rdl\" (UniqueName: \"kubernetes.io/projected/543185f8-be1e-40cb-9d02-77f63b0dfb0d-kube-api-access-x7rdl\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.826000 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-hostroot\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.826000 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfblq\" (UniqueName: \"kubernetes.io/projected/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-kube-api-access-qfblq\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.826000 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-conf\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.826000 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-tmp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.826614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.825948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32bb1370-fb10-465b-908c-21ccd5a74e23-konnectivity-ca\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.826766 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.826630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543185f8-be1e-40cb-9d02-77f63b0dfb0d-tmp-dir\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.827097 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-system-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827209 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.827209 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-host\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827209 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827435 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-run\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827503 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32bb1370-fb10-465b-908c-21ccd5a74e23-agent-certs\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.827503 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-cnibin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22lgr\" (UniqueName: \"kubernetes.io/projected/e1ce7b52-3340-40ee-be19-69a7e5888de8-kube-api-access-22lgr\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-kubernetes\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-systemd\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-lib-modules\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-os-release\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827644 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-cni-binary-copy\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-sys\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-var-lib-kubelet\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-etc-tuned\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-k8s-cni-cncf-io\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-bin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-daemon-config\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-etc-kubernetes\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58wsp\" (UniqueName: \"kubernetes.io/projected/54113414-001e-4f6c-ade6-0af552fc7b11-kube-api-access-58wsp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.827841 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-netns\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-multus-certs\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-modprobe-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysconfig\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/543185f8-be1e-40cb-9d02-77f63b0dfb0d-hosts-file\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-socket-dir-parent\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.827996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-multus\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.828009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-kubelet\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.828033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-conf-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.828195 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.828397 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.828281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.829088 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.828927 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 00:55:28.829201 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.829110 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 00:55:28.829270 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.829204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7jgqg\"" Jun 13 00:55:28.829471 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.829445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 00:55:28.829550 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.829484 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 00:55:28.829550 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.829493 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.830429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.830406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:28.830875 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.830858 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.831094 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.831008 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 00:55:28.831094 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.830911 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.831286 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.831185 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 00:55:28.831286 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.831238 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.831286 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.831223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.831286 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.831284 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s6rgf\"" Jun 13 00:55:28.833563 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.832880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.834122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.833681 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 00:55:28.834122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.833810 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4f6zk\"" Jun 13 00:55:28.834122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.833923 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 00:55:28.834122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.833947 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 00:55:28.834122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834045 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.834448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834301 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 00:55:28.834448 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834327 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 00:55:28.834560 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834456 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w7drh\"" Jun 13 00:55:28.834560 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgfnr\"" Jun 13 00:55:28.835006 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.834988 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 00:55:28.835122 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.835080 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 00:55:28.835643 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.835623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5lrst\"" Jun 13 00:55:28.843665 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.843645 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2jsvv\"" Jun 13 00:55:28.849815 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.849799 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:55:28.886866 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.886824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" event={"ID":"c99c5d3a6d53cba96f16302874cc68f6","Type":"ContainerStarted","Data":"da0df0d0062df648bf358b92d86f8cd1408ae6fa4646120de24bf698497850f1"} Jun 13 00:55:28.887875 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.887853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" event={"ID":"f341c26788f7c8a897d12eca4dbc7e0d","Type":"ContainerStarted","Data":"0e8e2a5d22d1e6de1037adacb95ef2694e6b47c3e590653bb5c8b5298d15f277"} Jun 13 00:55:28.888827 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.888810 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rm59" Jun 13 00:55:28.905707 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.905680 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rm59" Jun 13 00:55:28.916071 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.916049 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 00:55:28.928194 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.928288 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-var-lib-kubelet\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.928288 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-system-cni-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.928394 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928298 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-var-lib-kubelet\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.928394 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-node-log\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.928394 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-bin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928394 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-daemon-config\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-etc-kubernetes\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-host-slash\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-ovn\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-etc-kubernetes\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0b1203-9b43-418d-baa0-29f565f17edb-host\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-netns\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-bin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-multus-certs\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928566 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-netns\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.928614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysconfig\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.929024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-multus-certs\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scmqd\" (UniqueName: \"kubernetes.io/projected/bc743a47-89bd-4fa6-b891-0e55dc7a0157-kube-api-access-scmqd\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.929024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928737 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-etc-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.929024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-socket-dir-parent\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.928803 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysconfig\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.929284 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-daemon-config\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929284 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:28.929386 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-socket-dir-parent\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929386 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-kubelet\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.929479 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.929479 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-kubelet-config\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:28.929578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-registration-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.929629 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7rdl\" (UniqueName: \"kubernetes.io/projected/543185f8-be1e-40cb-9d02-77f63b0dfb0d-kube-api-access-x7rdl\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.929678 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-hostroot\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929729 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929716 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-hostroot\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.929778 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfblq\" (UniqueName: \"kubernetes.io/projected/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-kube-api-access-qfblq\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.929834 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-conf\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.929906 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-tmp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.929955 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-bin\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.930001 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-config\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.930001 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-conf\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.930235 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.929987 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:28.930345 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.930328 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 00:55:28.931624 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.931597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-host\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.931717 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.931646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.931775 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.931715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-host\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.931775 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.931753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.931880 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.931784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-systemd-units\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.932045 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-socket-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.932218 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.932337 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-sysctl-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.932449 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932337 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-run\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.932449 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.932449 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7fs7\" (UniqueName: \"kubernetes.io/projected/6b4233ce-f28c-4572-b8d0-69713ddcb132-kube-api-access-r7fs7\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.932636 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932434 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-run\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.932636 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-sys-fs\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.932983 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.932962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-kubernetes\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-kubernetes\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-systemd\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-lib-modules\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-systemd\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-os-release\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-cni-binary-copy\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933248 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-lib-modules\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-sys\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-etc-tuned\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-os-release\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-var-lib-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933306 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-sys\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-k8s-cni-cncf-io\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wsp\" (UniqueName: \"kubernetes.io/projected/54113414-001e-4f6c-ade6-0af552fc7b11-kube-api-access-58wsp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.933776 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-tmp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-run-k8s-cni-cncf-io\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-iptables-alerter-script\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-env-overrides\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-dbus\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-modprobe-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgrj\" (UniqueName: \"kubernetes.io/projected/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-kube-api-access-7tgrj\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovn-node-metrics-cert\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/543185f8-be1e-40cb-9d02-77f63b0dfb0d-hosts-file\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-multus\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54113414-001e-4f6c-ade6-0af552fc7b11-etc-modprobe-d\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-kubelet\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-conf-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cnibin\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/543185f8-be1e-40cb-9d02-77f63b0dfb0d-hosts-file\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-multus-conf-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-log-socket\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.934578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933725 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-kubelet\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1ce7b52-3340-40ee-be19-69a7e5888de8-cni-binary-copy\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-host-var-lib-cni-multus\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-device-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-os-release\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-systemd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32bb1370-fb10-465b-908c-21ccd5a74e23-konnectivity-ca\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543185f8-be1e-40cb-9d02-77f63b0dfb0d-tmp-dir\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.933921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-system-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-system-cni-dir\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934131 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-netd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.934214 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543185f8-be1e-40cb-9d02-77f63b0dfb0d-tmp-dir\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.934335 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:29.434300714 +0000 UTC m=+2.945716517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:28.935291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-slash\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-netns\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm9lf\" (UniqueName: \"kubernetes.io/projected/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kube-api-access-zm9lf\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b0b1203-9b43-418d-baa0-29f565f17edb-serviceca\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbqv\" (UniqueName: \"kubernetes.io/projected/6b0b1203-9b43-418d-baa0-29f565f17edb-kube-api-access-qqbqv\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32bb1370-fb10-465b-908c-21ccd5a74e23-agent-certs\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-cnibin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22lgr\" (UniqueName: \"kubernetes.io/projected/e1ce7b52-3340-40ee-be19-69a7e5888de8-kube-api-access-22lgr\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32bb1370-fb10-465b-908c-21ccd5a74e23-konnectivity-ca\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1ce7b52-3340-40ee-be19-69a7e5888de8-cnibin\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.934597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-script-lib\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:28.935976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.935821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54113414-001e-4f6c-ade6-0af552fc7b11-etc-tuned\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.937012 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.936994 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32bb1370-fb10-465b-908c-21ccd5a74e23-agent-certs\") pod \"konnectivity-agent-cfh2n\" (UID: \"32bb1370-fb10-465b-908c-21ccd5a74e23\") " pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:28.938626 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.938606 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:28.938701 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.938635 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:28.938701 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.938647 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:28.938785 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:28.938734 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:29.438704002 +0000 UTC m=+2.950119802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:28.940112 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.940085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7rdl\" (UniqueName: \"kubernetes.io/projected/543185f8-be1e-40cb-9d02-77f63b0dfb0d-kube-api-access-x7rdl\") pod \"node-resolver-kpjtl\" (UID: \"543185f8-be1e-40cb-9d02-77f63b0dfb0d\") " pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:28.941625 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.941603 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfblq\" (UniqueName: \"kubernetes.io/projected/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-kube-api-access-qfblq\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:28.945192 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.945157 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wsp\" (UniqueName: \"kubernetes.io/projected/54113414-001e-4f6c-ade6-0af552fc7b11-kube-api-access-58wsp\") pod \"tuned-2msz4\" (UID: \"54113414-001e-4f6c-ade6-0af552fc7b11\") " pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:28.954888 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:28.954861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22lgr\" (UniqueName: \"kubernetes.io/projected/e1ce7b52-3340-40ee-be19-69a7e5888de8-kube-api-access-22lgr\") pod \"multus-wkmk2\" (UID: \"e1ce7b52-3340-40ee-be19-69a7e5888de8\") " pod="openshift-multus/multus-wkmk2" Jun 13 00:55:29.035293 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035265 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-node-log\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-host-slash\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-host-slash\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-node-log\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-ovn\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0b1203-9b43-418d-baa0-29f565f17edb-host\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scmqd\" (UniqueName: \"kubernetes.io/projected/bc743a47-89bd-4fa6-b891-0e55dc7a0157-kube-api-access-scmqd\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.035433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-etc-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-kubelet\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0b1203-9b43-418d-baa0-29f565f17edb-host\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-etc-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-kubelet-config\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-registration-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-kubelet\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-bin\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-config\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035641 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035601 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-registration-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-kubelet-config\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-ovn\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.035825 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-systemd-units\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-bin\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.035738 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-socket-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.035801 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:29.535783252 +0000 UTC m=+3.047199046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035796 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-systemd-units\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7fs7\" (UniqueName: \"kubernetes.io/projected/6b4233ce-f28c-4572-b8d0-69713ddcb132-kube-api-access-r7fs7\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-sys-fs\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-var-lib-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-iptables-alerter-script\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-env-overrides\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.035982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-dbus\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgrj\" (UniqueName: \"kubernetes.io/projected/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-kube-api-access-7tgrj\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.036645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovn-node-metrics-cert\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036057 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cnibin\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-log-socket\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-log-socket\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-device-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-os-release\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-device-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-systemd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-netd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-config\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-slash\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-netns\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm9lf\" (UniqueName: \"kubernetes.io/projected/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kube-api-access-zm9lf\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.037388 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-slash\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-os-release\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036447 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-sys-fs\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-iptables-alerter-script\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6eaa436-6a21-4837-a427-6cbdaae027c7-dbus\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-systemd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-var-lib-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-cni-netd\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b0b1203-9b43-418d-baa0-29f565f17edb-serviceca\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-env-overrides\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbqv\" (UniqueName: \"kubernetes.io/projected/6b0b1203-9b43-418d-baa0-29f565f17edb-kube-api-access-qqbqv\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-socket-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc743a47-89bd-4fa6-b891-0e55dc7a0157-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036770 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-script-lib\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-cnibin\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036781 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-run-openvswitch\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036814 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-system-cni-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036828 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b4233ce-f28c-4572-b8d0-69713ddcb132-host-run-netns\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.036914 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc743a47-89bd-4fa6-b891-0e55dc7a0157-system-cni-dir\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.037247 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovnkube-script-lib\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.038631 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.037246 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b0b1203-9b43-418d-baa0-29f565f17edb-serviceca\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.038916 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.038854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b4233ce-f28c-4572-b8d0-69713ddcb132-ovn-node-metrics-cert\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.047930 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.047906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbqv\" (UniqueName: \"kubernetes.io/projected/6b0b1203-9b43-418d-baa0-29f565f17edb-kube-api-access-qqbqv\") pod \"node-ca-w5m6t\" (UID: \"6b0b1203-9b43-418d-baa0-29f565f17edb\") " pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.049087 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.049063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7fs7\" (UniqueName: \"kubernetes.io/projected/6b4233ce-f28c-4572-b8d0-69713ddcb132-kube-api-access-r7fs7\") pod \"ovnkube-node-cgfdp\" (UID: \"6b4233ce-f28c-4572-b8d0-69713ddcb132\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.049364 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.049344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgrj\" (UniqueName: \"kubernetes.io/projected/1bd183ee-5207-4120-8cbf-d9a0ddd21d90-kube-api-access-7tgrj\") pod \"iptables-alerter-fn5tw\" (UID: \"1bd183ee-5207-4120-8cbf-d9a0ddd21d90\") " pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.050561 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.050539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scmqd\" (UniqueName: \"kubernetes.io/projected/bc743a47-89bd-4fa6-b891-0e55dc7a0157-kube-api-access-scmqd\") pod \"multus-additional-cni-plugins-bnsf9\" (UID: \"bc743a47-89bd-4fa6-b891-0e55dc7a0157\") " pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.050873 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.050855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm9lf\" (UniqueName: \"kubernetes.io/projected/0c21bf05-e958-43d5-b30c-2f1e60aecdfc-kube-api-access-zm9lf\") pod \"aws-ebs-csi-driver-node-p9hgm\" (UID: \"0c21bf05-e958-43d5-b30c-2f1e60aecdfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.119651 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.119611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:29.129245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.129217 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpjtl" Jun 13 00:55:29.136353 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.136336 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wkmk2" Jun 13 00:55:29.142020 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.141998 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2msz4" Jun 13 00:55:29.149761 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.149743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fn5tw" Jun 13 00:55:29.155368 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.155345 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:29.162507 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.162490 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" Jun 13 00:55:29.168064 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.168048 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5m6t" Jun 13 00:55:29.172691 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.172677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" Jun 13 00:55:29.439971 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.439879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:29.439971 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.439938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440056 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440068 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440085 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440097 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440121 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:30.440105046 +0000 UTC m=+3.951520837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:29.440182 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.440135 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:30.440129254 +0000 UTC m=+3.951545041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:29.541060 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.541029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:29.541214 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.541132 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:29.541214 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:29.541197 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:30.54118246 +0000 UTC m=+4.052598247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:29.882320 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.882289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c21bf05_e958_43d5_b30c_2f1e60aecdfc.slice/crio-e1e4fdec89af4bd26cce2d5fa239d94681dc644c8daa6a13ca85e6bc4737aefd WatchSource:0}: Error finding container e1e4fdec89af4bd26cce2d5fa239d94681dc644c8daa6a13ca85e6bc4737aefd: Status 404 returned error can't find the container with id e1e4fdec89af4bd26cce2d5fa239d94681dc644c8daa6a13ca85e6bc4737aefd Jun 13 00:55:29.883246 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.883219 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54113414_001e_4f6c_ade6_0af552fc7b11.slice/crio-faf3c397be234fb9fce01fbb55706e90548babd095a0d4f467bd9e4db4f2d5c5 WatchSource:0}: Error finding container faf3c397be234fb9fce01fbb55706e90548babd095a0d4f467bd9e4db4f2d5c5: Status 404 returned error can't find the container with id faf3c397be234fb9fce01fbb55706e90548babd095a0d4f467bd9e4db4f2d5c5 Jun 13 00:55:29.884043 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.884022 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc743a47_89bd_4fa6_b891_0e55dc7a0157.slice/crio-9008cebf83eff2af73b1ec792404812ca1990a9dac30a6b06e9e085002b3979f WatchSource:0}: Error finding container 9008cebf83eff2af73b1ec792404812ca1990a9dac30a6b06e9e085002b3979f: Status 404 returned error can't find the container with id 9008cebf83eff2af73b1ec792404812ca1990a9dac30a6b06e9e085002b3979f Jun 13 00:55:29.884690 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.884629 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4233ce_f28c_4572_b8d0_69713ddcb132.slice/crio-17759bafa72c26699204491f681d03ba9872f7809d46755bddb4b093aac601d7 WatchSource:0}: Error finding container 17759bafa72c26699204491f681d03ba9872f7809d46755bddb4b093aac601d7: Status 404 returned error can't find the container with id 17759bafa72c26699204491f681d03ba9872f7809d46755bddb4b093aac601d7 Jun 13 00:55:29.888816 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.888795 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ce7b52_3340_40ee_be19_69a7e5888de8.slice/crio-8f3458d50a8b27d1ef580948265c9fb050d287fdfb4870b2df83a06add62c61a WatchSource:0}: Error finding container 8f3458d50a8b27d1ef580948265c9fb050d287fdfb4870b2df83a06add62c61a: Status 404 returned error can't find the container with id 8f3458d50a8b27d1ef580948265c9fb050d287fdfb4870b2df83a06add62c61a Jun 13 00:55:29.889407 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.889384 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bb1370_fb10_465b_908c_21ccd5a74e23.slice/crio-49c4f13a5f88e4aa93626110bdbd47e3aafde10d557fd8e71c6c450d3b0ffc88 WatchSource:0}: Error finding container 49c4f13a5f88e4aa93626110bdbd47e3aafde10d557fd8e71c6c450d3b0ffc88: Status 404 returned error can't find the container with id 49c4f13a5f88e4aa93626110bdbd47e3aafde10d557fd8e71c6c450d3b0ffc88 Jun 13 00:55:29.890339 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:55:29.890317 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543185f8_be1e_40cb_9d02_77f63b0dfb0d.slice/crio-36e9a03ce805ad2f2175d9c0c0b7cae15c631bf5c4f7b0f71b8c5cfa89399d85 WatchSource:0}: Error finding container 36e9a03ce805ad2f2175d9c0c0b7cae15c631bf5c4f7b0f71b8c5cfa89399d85: Status 404 returned error can't find the container with id 36e9a03ce805ad2f2175d9c0c0b7cae15c631bf5c4f7b0f71b8c5cfa89399d85 Jun 13 00:55:29.891057 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.890958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" event={"ID":"0c21bf05-e958-43d5-b30c-2f1e60aecdfc","Type":"ContainerStarted","Data":"e1e4fdec89af4bd26cce2d5fa239d94681dc644c8daa6a13ca85e6bc4737aefd"} Jun 13 00:55:29.895843 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.895530 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"17759bafa72c26699204491f681d03ba9872f7809d46755bddb4b093aac601d7"} Jun 13 00:55:29.897233 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.897203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerStarted","Data":"9008cebf83eff2af73b1ec792404812ca1990a9dac30a6b06e9e085002b3979f"} Jun 13 00:55:29.898282 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.898261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2msz4" event={"ID":"54113414-001e-4f6c-ade6-0af552fc7b11","Type":"ContainerStarted","Data":"faf3c397be234fb9fce01fbb55706e90548babd095a0d4f467bd9e4db4f2d5c5"} Jun 13 00:55:29.909217 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.908917 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:50:28 +0000 UTC" deadline="2027-11-12 13:13:54.202756828 +0000 UTC" Jun 13 00:55:29.909217 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:29.909151 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12420h18m24.29361095s" Jun 13 00:55:30.446967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.446883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:30.446967 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.446965 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:30.447221 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447137 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:30.447221 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447154 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:30.447221 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447182 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:30.447384 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447242 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:32.447223726 +0000 UTC m=+5.958639514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:30.447647 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447626 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:30.447715 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.447685 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:32.44766949 +0000 UTC m=+5.959085278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:30.547998 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.547369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:30.547998 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.547550 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:30.547998 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.547611 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:32.547593386 +0000 UTC m=+6.059009186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:30.656198 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.656150 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:30.662270 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.662248 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.891309 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.891475 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.892026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.892192 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.892289 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:30.893218 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:30.892383 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:30.909412 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.909332 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:50:28 +0000 UTC" deadline="2027-12-15 08:06:41.950624426 +0000 UTC" Jun 13 00:55:30.909412 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.909384 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13207h11m11.041244604s" Jun 13 00:55:30.911307 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.911232 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fn5tw" event={"ID":"1bd183ee-5207-4120-8cbf-d9a0ddd21d90","Type":"ContainerStarted","Data":"b8ce295b0d1b83ff3f8cf39a664dff96b4b5db0b49b0a75ba1d1ec3059c0520b"} Jun 13 00:55:30.935517 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.935462 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpjtl" event={"ID":"543185f8-be1e-40cb-9d02-77f63b0dfb0d","Type":"ContainerStarted","Data":"36e9a03ce805ad2f2175d9c0c0b7cae15c631bf5c4f7b0f71b8c5cfa89399d85"} Jun 13 00:55:30.938373 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.938344 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfh2n" event={"ID":"32bb1370-fb10-465b-908c-21ccd5a74e23","Type":"ContainerStarted","Data":"49c4f13a5f88e4aa93626110bdbd47e3aafde10d557fd8e71c6c450d3b0ffc88"} Jun 13 00:55:30.961075 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.961006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" event={"ID":"f341c26788f7c8a897d12eca4dbc7e0d","Type":"ContainerStarted","Data":"fc9a05d789e341b6e7d38598f86fe0442ff0106a67b38882f8e3354a51eabb42"} Jun 13 00:55:30.968727 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.968696 2558 generic.go:356] "Generic (PLEG): container finished" podID="c99c5d3a6d53cba96f16302874cc68f6" containerID="407c3285531d58c97764eda399496608147aa85e8694d624a88b934daf3e26ec" exitCode=0 Jun 13 00:55:30.968849 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.968774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" event={"ID":"c99c5d3a6d53cba96f16302874cc68f6","Type":"ContainerDied","Data":"407c3285531d58c97764eda399496608147aa85e8694d624a88b934daf3e26ec"} Jun 13 00:55:30.975939 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.975737 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-23.ec2.internal" podStartSLOduration=2.975717745 podStartE2EDuration="2.975717745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:30.975187592 +0000 UTC m=+4.486603402" watchObservedRunningTime="2026-06-13 00:55:30.975717745 +0000 UTC m=+4.487133558" Jun 13 00:55:30.981580 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.981441 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5m6t" event={"ID":"6b0b1203-9b43-418d-baa0-29f565f17edb","Type":"ContainerStarted","Data":"9d6f76dc095cfea5a31fd5dbf3705258793783e13869d3d7843ee224901d63a5"} Jun 13 00:55:30.987949 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:30.987887 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wkmk2" event={"ID":"e1ce7b52-3340-40ee-be19-69a7e5888de8","Type":"ContainerStarted","Data":"8f3458d50a8b27d1ef580948265c9fb050d287fdfb4870b2df83a06add62c61a"} Jun 13 00:55:32.011445 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.011405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" event={"ID":"c99c5d3a6d53cba96f16302874cc68f6","Type":"ContainerStarted","Data":"e862b813930b6f4538bc78ae9e33d7a73fede13c83562c4fbea464fd2d1aaf1f"} Jun 13 00:55:32.466006 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.465967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:32.466207 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.466061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:32.466292 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466205 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:32.466292 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466224 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:32.466292 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466235 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:32.466476 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466356 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:36.466334928 +0000 UTC m=+9.977750728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:32.466838 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466811 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:32.466950 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.466862 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:36.466849389 +0000 UTC m=+9.978265183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:32.567581 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.567494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:32.567799 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.567784 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:32.567871 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.567849 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:36.567829741 +0000 UTC m=+10.079245534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:32.885078 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.885045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:32.885305 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.885278 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:32.885697 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.885677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:32.885812 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.885791 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:32.885857 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:32.885843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:32.885927 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:32.885910 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:34.883727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:34.883727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:34.883860 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:34.883727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:34.883922 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:34.884199 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:34.884133 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:36.500744 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.500711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:36.500744 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.500751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:36.501329 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.500877 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:36.501329 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.500952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:44.500930066 +0000 UTC m=+18.012345868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:36.501329 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.500881 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:36.501329 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.501329 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:36.501544 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.501345 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:36.501544 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.501404 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:44.501386519 +0000 UTC m=+18.012802321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:36.601664 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.601625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:36.601847 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.601773 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:36.601847 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.601844 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:55:44.601824023 +0000 UTC m=+18.113239824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:36.884487 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.884449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:36.884758 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.884569 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:36.885096 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.884947 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:36.885096 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.885055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:36.885303 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:36.885216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:36.885357 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:36.885320 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:38.883804 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:38.883764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:38.884300 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:38.883903 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:38.884300 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:38.884016 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:38.884300 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:38.883899 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:38.884300 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:38.883765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:38.884300 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:38.884107 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:40.883083 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:40.883047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:40.883083 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:40.883076 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:40.883664 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:40.883047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:40.883664 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:40.883160 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:40.883664 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:40.883233 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:40.883664 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:40.883369 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:42.883279 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:42.883239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:42.883714 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:42.883240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:42.883714 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:42.883379 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:42.883714 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:42.883247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:42.883714 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:42.883480 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:42.883714 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:42.883533 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:44.563199 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.563158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.563214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563299 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563336 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563354 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:00.563342256 +0000 UTC m=+34.074758042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563364 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:44.563576 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.563400 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:00.563389259 +0000 UTC m=+34.074805047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:55:44.664422 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.664395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:44.664552 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.664534 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:44.664611 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.664600 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:00.664584009 +0000 UTC m=+34.175999810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:55:44.883032 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.882994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:44.883244 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.882994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:44.883244 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.883141 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:44.883244 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:44.883000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:44.883244 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.883231 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:44.883434 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:44.883288 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:46.883619 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:46.883584 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:46.884070 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:46.883699 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:46.884070 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:46.883766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:46.884070 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:46.883855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:46.884070 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:46.883879 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:46.884070 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:46.883950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:48.883359 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:48.883085 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:48.884202 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:48.883085 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:48.884202 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:48.883478 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:48.884202 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:48.883126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:48.884202 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:48.883541 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:48.884202 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:48.883678 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:49.045926 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.045899 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="45b9b8f84af4699bfeba3efdafdca70a4aa8f2655efc80eb2c9889b1e686709a" exitCode=0 Jun 13 00:55:49.046027 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.045983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"45b9b8f84af4699bfeba3efdafdca70a4aa8f2655efc80eb2c9889b1e686709a"} Jun 13 00:55:49.047456 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.047430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5m6t" event={"ID":"6b0b1203-9b43-418d-baa0-29f565f17edb","Type":"ContainerStarted","Data":"0a3d0465763a9d47b3d7c40363c578148575a5886e20d727666ed9c3e6a4aad0"} Jun 13 00:55:49.048850 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.048828 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wkmk2" event={"ID":"e1ce7b52-3340-40ee-be19-69a7e5888de8","Type":"ContainerStarted","Data":"bb106abd6cc7ad43897559745fc9ad9dde14aa8f6fb3f80e1489c553ff6b0be2"} Jun 13 00:55:49.050555 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.050539 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 00:55:49.050890 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.050869 2558 generic.go:356] "Generic (PLEG): container finished" podID="6b4233ce-f28c-4572-b8d0-69713ddcb132" containerID="fa7007cc0cac1abe53222f655d993ce593af808555f6376db54e32dff77ae0d6" exitCode=1 Jun 13 00:55:49.050956 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.050936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"e5ad9e0e7770c26e4aff535989b4f549d3a7c7ef3a09fa173df8a9f2cce9f353"} Jun 13 00:55:49.051016 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.051003 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerDied","Data":"fa7007cc0cac1abe53222f655d993ce593af808555f6376db54e32dff77ae0d6"} Jun 13 00:55:49.051069 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.051055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"751c098935c8c314cc77775be9c584f98e7217953e0b0ff110f7a67dfc42b04b"} Jun 13 00:55:49.052221 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.052200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2msz4" event={"ID":"54113414-001e-4f6c-ade6-0af552fc7b11","Type":"ContainerStarted","Data":"c56e94b87b19d4956a56405a48420607e2d50777e663ad5f6b119c6c0d2c35da"} Jun 13 00:55:49.053608 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.053591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" event={"ID":"0c21bf05-e958-43d5-b30c-2f1e60aecdfc","Type":"ContainerStarted","Data":"a4b7aa782b421e822788c0948ec47d2dabe57537c5f82c34b82be764aba00120"} Jun 13 00:55:49.054958 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.054938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpjtl" event={"ID":"543185f8-be1e-40cb-9d02-77f63b0dfb0d","Type":"ContainerStarted","Data":"7753f97bcf5f1b33bbe7643c2d90fb54f41ba4baba570d93d84c0ff26ba9a853"} Jun 13 00:55:49.056447 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.056428 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfh2n" event={"ID":"32bb1370-fb10-465b-908c-21ccd5a74e23","Type":"ContainerStarted","Data":"82cc80b1bfd44a9218ab94956bd7f280d038c33990c4d14e8ff914fcfbf7b01d"} Jun 13 00:55:49.069811 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.069767 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-23.ec2.internal" podStartSLOduration=21.069756504 podStartE2EDuration="21.069756504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:32.028905893 +0000 UTC m=+5.540321729" watchObservedRunningTime="2026-06-13 00:55:49.069756504 +0000 UTC m=+22.581172313" Jun 13 00:55:49.084911 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.084880 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cfh2n" podStartSLOduration=4.563593142 podStartE2EDuration="23.084868306s" totalImagesPullingTime="18.521275164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:49.08482964 +0000 UTC m=+22.596245459" watchObservedRunningTime="2026-06-13 00:55:49.084868306 +0000 UTC m=+22.596284115" Jun 13 00:55:49.119429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.119224 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kpjtl" podStartSLOduration=3.599775551 podStartE2EDuration="22.119207088s" totalImagesPullingTime="18.519431537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:49.099566482 +0000 UTC m=+22.610982291" watchObservedRunningTime="2026-06-13 00:55:49.119207088 +0000 UTC m=+22.630622899" Jun 13 00:55:49.119896 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.119869 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wkmk2" podStartSLOduration=3.270528546 podStartE2EDuration="22.119858831s" totalImagesPullingTime="18.849330285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:49.11914845 +0000 UTC m=+22.630564259" watchObservedRunningTime="2026-06-13 00:55:49.119858831 +0000 UTC m=+22.631274639" Jun 13 00:55:49.138000 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.137960 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2msz4" podStartSLOduration=3.5269482439999997 podStartE2EDuration="22.137946523s" totalImagesPullingTime="18.610998279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:49.137396475 +0000 UTC m=+22.648812318" watchObservedRunningTime="2026-06-13 00:55:49.137946523 +0000 UTC m=+22.649362332" Jun 13 00:55:49.155293 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.155260 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5m6t" podStartSLOduration=3.554523431 podStartE2EDuration="22.155248119s" totalImagesPullingTime="18.600724688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:49.154657309 +0000 UTC m=+22.666073119" watchObservedRunningTime="2026-06-13 00:55:49.155248119 +0000 UTC m=+22.666663980" Jun 13 00:55:49.400857 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.400824 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:49.401403 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:49.401377 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:50.062021 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.061998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 00:55:50.062728 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.062698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"71d11919abc09a1ba590fe8987bd80dd6bea167caa0c8dde72843dab1b1aae1e"} Jun 13 00:55:50.062838 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.062790 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"07ca0f8d35bb0eec75f5d4b885d4a184c9e9f9d37906d8a1f4f0c55904359827"} Jun 13 00:55:50.062883 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.062839 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"5803bd5d5b5d8c6d40cec8b4822869367f42bdee77db56c9bbc01a15bb06ddd0"} Jun 13 00:55:50.064271 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.064242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fn5tw" event={"ID":"1bd183ee-5207-4120-8cbf-d9a0ddd21d90","Type":"ContainerStarted","Data":"99246b0479585bcae149a129a2dba55e74b11f9ef9e6f329bea8ea31f3c731f9"} Jun 13 00:55:50.064808 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.064417 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:50.064918 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.064873 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cfh2n" Jun 13 00:55:50.078798 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.078762 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fn5tw" podStartSLOduration=4.471403115 podStartE2EDuration="23.078748983s" totalImagesPullingTime="18.607345868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:50.078449828 +0000 UTC m=+23.589865638" watchObservedRunningTime="2026-06-13 00:55:50.078748983 +0000 UTC m=+23.590164792" Jun 13 00:55:50.153498 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.153352 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 00:55:50.882892 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.882769 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T00:55:50.153484799Z","UUID":"537df554-63ee-4ecf-a2f0-f76618a9e4c5","Handler":null,"Name":"","Endpoint":""} Jun 13 00:55:50.883082 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.882959 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:50.883082 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:50.883068 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:50.883213 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.883132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:50.883313 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:50.883282 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:50.883381 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.883301 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:50.883902 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:50.883396 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:50.884519 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.884499 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 00:55:50.884639 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:50.884541 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 00:55:51.068976 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:51.068937 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" event={"ID":"0c21bf05-e958-43d5-b30c-2f1e60aecdfc","Type":"ContainerStarted","Data":"6640953574ce6109d7894753540a44e7f563d5777183321d788e839ce79c50ec"} Jun 13 00:55:52.073613 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.073586 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 00:55:52.074119 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.073950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"52df921b87c64df67500080c1773bb0606399846769d5b325b3bac0f37489b83"} Jun 13 00:55:52.075931 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.075901 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" event={"ID":"0c21bf05-e958-43d5-b30c-2f1e60aecdfc","Type":"ContainerStarted","Data":"25280455a0b06432d9ba0451d68a574fcfe1a574f821b912a605e3185522ac06"} Jun 13 00:55:52.093824 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.093780 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9hgm" podStartSLOduration=3.845382113 podStartE2EDuration="25.093768232s" totalImagesPullingTime="21.248386119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:52.093634509 +0000 UTC m=+25.605050309" watchObservedRunningTime="2026-06-13 00:55:52.093768232 +0000 UTC m=+25.605184041" Jun 13 00:55:52.883429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.883403 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:52.883429 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.883421 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:52.883644 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:52.883400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:52.883644 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:52.883519 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:52.883644 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:52.883608 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:52.883770 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:52.883740 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:54.883127 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:54.882936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:54.883780 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:54.882936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:54.883780 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:54.883216 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:54.883780 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:54.883000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:54.883780 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:54.883281 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:54.883780 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:54.883341 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:55.084022 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.083991 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="af17a9d0fb0bb5c4e9d91adda245da7f84faaf460cb9e7253a917ec67993bcc7" exitCode=0 Jun 13 00:55:55.084157 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.084075 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"af17a9d0fb0bb5c4e9d91adda245da7f84faaf460cb9e7253a917ec67993bcc7"} Jun 13 00:55:55.087753 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.087730 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 00:55:55.088132 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.088104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"ba6fbaedd23321a6e5bc83fbc7d07a5c77f67dc82c309f0e4bb65148dd4d2f3c"} Jun 13 00:55:55.088436 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.088418 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:55.088606 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.088591 2558 scope.go:117] "RemoveContainer" containerID="fa7007cc0cac1abe53222f655d993ce593af808555f6376db54e32dff77ae0d6" Jun 13 00:55:55.104992 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:55.104970 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:56.094121 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.094074 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 00:55:56.094595 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.094460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" event={"ID":"6b4233ce-f28c-4572-b8d0-69713ddcb132","Type":"ContainerStarted","Data":"afdbc2a880e54e5b444ac653cea706bf9eba1f6332081d284e1038a43d4a5381"} Jun 13 00:55:56.094595 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.094534 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 00:55:56.094789 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.094773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:56.109521 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.109496 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:56.119671 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.119632 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" podStartSLOduration=10.48203513 podStartE2EDuration="29.119616419s" totalImagesPullingTime="18.637581289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:55:56.119050902 +0000 UTC m=+29.630466710" watchObservedRunningTime="2026-06-13 00:55:56.119616419 +0000 UTC m=+29.631032229" Jun 13 00:55:56.175118 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.175092 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvstp"] Jun 13 00:55:56.175232 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.175205 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:56.175310 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:56.175285 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:56.178258 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.178237 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq4cd"] Jun 13 00:55:56.178362 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.178348 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:56.178467 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:56.178446 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:56.178977 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.178956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrtvs"] Jun 13 00:55:56.179078 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:56.179064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:56.179229 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:56.179209 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:57.099125 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.098873 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="8e077158e78c64d46d8aefcd31da442abc7b40247c68437f2efa62a525a59b60" exitCode=0 Jun 13 00:55:57.099125 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.098958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"8e077158e78c64d46d8aefcd31da442abc7b40247c68437f2efa62a525a59b60"} Jun 13 00:55:57.099563 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.099274 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 00:55:57.883534 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.883498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:57.883711 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.883498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:57.883711 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:57.883610 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:57.883711 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:57.883498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:57.883711 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:57.883682 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:55:57.883880 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:57.883777 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:58.101620 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:58.101595 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 00:55:58.220381 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:58.220269 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:55:59.108986 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.108956 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="0ef1692f8713584cf1fe2d75399a273a4cf221c7b58ca0629c7501f8d3708633" exitCode=0 Jun 13 00:55:59.109618 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.109035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"0ef1692f8713584cf1fe2d75399a273a4cf221c7b58ca0629c7501f8d3708633"} Jun 13 00:55:59.119507 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.119471 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" podUID="6b4233ce-f28c-4572-b8d0-69713ddcb132" containerName="ovnkube-controller" probeResult="failure" output="" Jun 13 00:55:59.882959 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.882926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:55:59.883308 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.883025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:55:59.883308 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:59.883031 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:55:59.883308 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:55:59.883058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:55:59.883308 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:59.883137 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:55:59.883308 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:55:59.883231 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:56:00.579689 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:00.579649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:00.579809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579841 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579863 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579873 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq97x for pod openshift-network-diagnostics/network-check-target-mq4cd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579914 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579938 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x podName:dffd43c1-cd44-44f8-afc6-8964394659c8 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:32.579924124 +0000 UTC m=+66.091339914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq97x" (UniqueName: "kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x") pod "network-check-target-mq4cd" (UID: "dffd43c1-cd44-44f8-afc6-8964394659c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:00.580288 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.579967 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:32.579950439 +0000 UTC m=+66.091366226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:00.680930 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:00.680846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:00.681075 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.680974 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:00.681219 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:00.681203 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret podName:c6eaa436-6a21-4837-a427-6cbdaae027c7 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:32.681133306 +0000 UTC m=+66.192549107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret") pod "global-pull-secret-syncer-pvstp" (UID: "c6eaa436-6a21-4837-a427-6cbdaae027c7") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:01.882808 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:01.882773 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:01.883291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:01.882814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:01.883291 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:01.882884 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:56:01.883291 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:01.882904 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvstp" podUID="c6eaa436-6a21-4837-a427-6cbdaae027c7" Jun 13 00:56:01.883291 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:01.882972 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:56:01.883291 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:01.883044 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq4cd" podUID="dffd43c1-cd44-44f8-afc6-8964394659c8" Jun 13 00:56:02.286274 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.286244 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-23.ec2.internal" event="NodeReady" Jun 13 00:56:02.286455 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.286403 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 00:56:02.343246 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.343208 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 00:56:02.345519 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.345498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.347441 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.347417 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 00:56:02.348018 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.347998 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 00:56:02.348204 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.348135 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rclk4\"" Jun 13 00:56:02.348614 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.348589 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 00:56:02.355702 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.355498 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 00:56:02.365370 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.365344 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 00:56:02.372780 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.372754 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rw8dv"] Jun 13 00:56:02.374678 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.374662 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.377164 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.377141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 00:56:02.377290 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.377194 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 00:56:02.377650 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.377626 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v656w\"" Jun 13 00:56:02.378780 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.378757 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-247nk"] Jun 13 00:56:02.380582 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.380562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.382274 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.382251 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 00:56:02.382366 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.382349 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 00:56:02.382694 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.382677 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jnkdp\"" Jun 13 00:56:02.382797 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.382781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 00:56:02.393992 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.393958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rw8dv"] Jun 13 00:56:02.411391 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.411320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-247nk"] Jun 13 00:56:02.494604 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-kube-api-access-ql2nv\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.494784 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fltxz\" (UniqueName: \"kubernetes.io/projected/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-kube-api-access-fltxz\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.494784 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gts\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.494784 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-config-volume\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.494784 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.494784 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-cert\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.494975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.495001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.495039 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.495027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.495317 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.495048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-tmp-dir\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.596407 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fltxz\" (UniqueName: \"kubernetes.io/projected/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-kube-api-access-fltxz\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.596407 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596409 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gts\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596641 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-config-volume\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.596641 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596744 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596621 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-cert\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.596744 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596744 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596793 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:02.596845 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:02.596862 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:02.596887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.597234 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-tmp-dir\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.597234 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:02.596917 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:03.096898687 +0000 UTC m=+36.608314473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:02.597234 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.596986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-kube-api-access-ql2nv\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.597234 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.597200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-config-volume\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.597974 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.597501 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-tmp-dir\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.597974 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:02.597596 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:02.597974 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:02.597645 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:03.09763251 +0000 UTC m=+36.609048296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:02.597974 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.597649 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.597974 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.597719 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.598313 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.598041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.601717 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.601696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.601717 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.601713 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-cert\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.601885 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.601701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.609659 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.609121 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:02.609659 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.609539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/cee7da03-acd7-4363-8c7d-cdc00c3faa1c-kube-api-access-ql2nv\") pod \"ingress-canary-247nk\" (UID: \"cee7da03-acd7-4363-8c7d-cdc00c3faa1c\") " pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.609849 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.609701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fltxz\" (UniqueName: \"kubernetes.io/projected/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-kube-api-access-fltxz\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:02.610024 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.609980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.610758 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.610737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gts\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:02.693338 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.693260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-247nk" Jun 13 00:56:02.706578 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:02.706549 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:03.100951 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.100914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.101009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:03.101083 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:03.101123 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:03.101134 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:03.101158 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:04.101140973 +0000 UTC m=+37.612556773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:03.101404 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:03.101204 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:04.101188124 +0000 UTC m=+37.612603923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:03.766111 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.765998 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-247nk"] Jun 13 00:56:03.771187 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:56:03.771152 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee7da03_acd7_4363_8c7d_cdc00c3faa1c.slice/crio-70ef6adcda91b94a40142c9ad86a2067465124248a03593c3835b544d48dfb53 WatchSource:0}: Error finding container 70ef6adcda91b94a40142c9ad86a2067465124248a03593c3835b544d48dfb53: Status 404 returned error can't find the container with id 70ef6adcda91b94a40142c9ad86a2067465124248a03593c3835b544d48dfb53 Jun 13 00:56:03.883332 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.883292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:03.883332 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.883305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:56:03.883577 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.883541 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:03.890050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.889527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtkg2\"" Jun 13 00:56:03.890050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.889560 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:56:03.890050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.889632 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v7h5\"" Jun 13 00:56:03.890050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.889660 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:56:03.890050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.889569 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:56:03.890374 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:03.890060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:56:04.110520 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:04.110487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:04.110539 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:04.110656 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:04.110661 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:04.110682 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:04.110711 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:06.110693421 +0000 UTC m=+39.622109215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:04.111008 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:04.110778 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:06.110767962 +0000 UTC m=+39.622183751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:04.124733 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:04.124703 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="3ea15c6c63e169aeb8514f72ab197a77fc469656a371a0bf4198738828856664" exitCode=0 Jun 13 00:56:04.124901 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:04.124796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"3ea15c6c63e169aeb8514f72ab197a77fc469656a371a0bf4198738828856664"} Jun 13 00:56:04.126387 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:04.126338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-247nk" event={"ID":"cee7da03-acd7-4363-8c7d-cdc00c3faa1c","Type":"ContainerStarted","Data":"70ef6adcda91b94a40142c9ad86a2067465124248a03593c3835b544d48dfb53"} Jun 13 00:56:05.132648 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:05.132604 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc743a47-89bd-4fa6-b891-0e55dc7a0157" containerID="6ae2c92c5d6f7f842ba525ce5f138a03e2426885790a12087a54a481383f5bb8" exitCode=0 Jun 13 00:56:05.133058 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:05.132675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerDied","Data":"6ae2c92c5d6f7f842ba525ce5f138a03e2426885790a12087a54a481383f5bb8"} Jun 13 00:56:05.788852 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:05.788817 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:05.889269 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:05.889235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:06.128576 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.128549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:06.128739 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.128601 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:06.128739 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:06.128696 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:06.128739 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:06.128711 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:06.128847 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:06.128757 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:10.128742851 +0000 UTC m=+43.640158638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:06.128847 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:06.128774 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:06.128847 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:06.128809 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:10.12879943 +0000 UTC m=+43.640215217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:06.136705 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.136684 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-247nk" event={"ID":"cee7da03-acd7-4363-8c7d-cdc00c3faa1c","Type":"ContainerStarted","Data":"abeab6f8bc120141270554759f68d27ee6b2064ca245c1fce91d6362ee82ebb8"} Jun 13 00:56:06.140287 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.140267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" event={"ID":"bc743a47-89bd-4fa6-b891-0e55dc7a0157","Type":"ContainerStarted","Data":"f106746047403f8b19c7e81a7bf4c1524f27f29e66c0b7a8cfc36209aa168690"} Jun 13 00:56:06.151510 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.151469 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-247nk" podStartSLOduration=2.204551496 podStartE2EDuration="4.15145757s" totalImagesPullingTime="1.946906074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:06.151034443 +0000 UTC m=+39.662450251" watchObservedRunningTime="2026-06-13 00:56:06.15145757 +0000 UTC m=+39.662873378" Jun 13 00:56:06.177106 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.175263 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bnsf9" podStartSLOduration=8.691526343 podStartE2EDuration="39.175246463s" totalImagesPullingTime="30.48372012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:06.174828951 +0000 UTC m=+39.686244761" watchObservedRunningTime="2026-06-13 00:56:06.175246463 +0000 UTC m=+39.686662273" Jun 13 00:56:06.303504 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.303468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:06.365543 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:06.365509 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:08.638474 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:08.638438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:08.694936 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:08.694905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:10.156837 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:10.156805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:10.156858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:10.156951 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:10.156967 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:10.156970 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:10.157019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:18.157003967 +0000 UTC m=+51.668419755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:10.157216 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:10.157034 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:18.157028207 +0000 UTC m=+51.668443993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:10.241887 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:10.241858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:10.344596 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:10.344564 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:13.125616 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:13.125570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:13.194704 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:13.194669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:13.472278 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:13.472157 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:13.539590 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:13.539560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:15.621105 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:15.621066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:15.701468 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:15.701430 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:15.799404 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:15.799374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:16.577588 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:16.577555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:17.662512 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:17.662482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:17.757995 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:17.757970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:18.214907 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:18.214869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:18.215140 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:18.214945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:18.215140 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:18.215038 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:18.215140 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:18.215062 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:18.215140 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:18.215111 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:34.215095441 +0000 UTC m=+67.726511231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:18.215140 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:18.215049 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:18.215374 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:18.215218 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:34.215198924 +0000 UTC m=+67.726614721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:28.018423 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:28.018395 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:28.119241 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:28.119201 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:29.118964 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:29.118936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgfdp" Jun 13 00:56:29.281639 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:29.281603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:29.381308 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:29.381202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:32.623159 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.623121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:32.623554 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.623282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:56:32.626899 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.626880 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:56:32.626975 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.626912 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:56:32.633822 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:32.633806 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 00:56:32.633872 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:32.633863 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:36.633846979 +0000 UTC m=+130.145262769 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : secret "metrics-daemon-secret" not found Jun 13 00:56:32.635533 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.635519 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:56:32.648262 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.648236 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq97x\" (UniqueName: \"kubernetes.io/projected/dffd43c1-cd44-44f8-afc6-8964394659c8-kube-api-access-dq97x\") pod \"network-check-target-mq4cd\" (UID: \"dffd43c1-cd44-44f8-afc6-8964394659c8\") " pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:32.724150 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.724112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:32.726325 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.726308 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:56:32.737072 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.737046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6eaa436-6a21-4837-a427-6cbdaae027c7-original-pull-secret\") pod \"global-pull-secret-syncer-pvstp\" (UID: \"c6eaa436-6a21-4837-a427-6cbdaae027c7\") " pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:32.738921 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.738906 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtkg2\"" Jun 13 00:56:32.747844 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.747827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:32.747920 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.747827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvstp" Jun 13 00:56:32.892509 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.892433 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq4cd"] Jun 13 00:56:32.895349 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:56:32.895320 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffd43c1_cd44_44f8_afc6_8964394659c8.slice/crio-c725fb42419224e2991a2fc0794536090219106226862af490c45e4c1aac92d1 WatchSource:0}: Error finding container c725fb42419224e2991a2fc0794536090219106226862af490c45e4c1aac92d1: Status 404 returned error can't find the container with id c725fb42419224e2991a2fc0794536090219106226862af490c45e4c1aac92d1 Jun 13 00:56:32.908721 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:32.908687 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvstp"] Jun 13 00:56:32.911629 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:56:32.911605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eaa436_6a21_4837_a427_6cbdaae027c7.slice/crio-8fccc469f605c5143693ebfd35407cab0888e446a9eff9cb105f4814f40d2276 WatchSource:0}: Error finding container 8fccc469f605c5143693ebfd35407cab0888e446a9eff9cb105f4814f40d2276: Status 404 returned error can't find the container with id 8fccc469f605c5143693ebfd35407cab0888e446a9eff9cb105f4814f40d2276 Jun 13 00:56:33.162032 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:33.161947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:33.204475 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:33.204444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvstp" event={"ID":"c6eaa436-6a21-4837-a427-6cbdaae027c7","Type":"ContainerStarted","Data":"8fccc469f605c5143693ebfd35407cab0888e446a9eff9cb105f4814f40d2276"} Jun 13 00:56:33.205450 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:33.205430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq4cd" event={"ID":"dffd43c1-cd44-44f8-afc6-8964394659c8","Type":"ContainerStarted","Data":"c725fb42419224e2991a2fc0794536090219106226862af490c45e4c1aac92d1"} Jun 13 00:56:33.231487 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:33.231458 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:34.234249 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:34.234215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:34.234296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:34.234395 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:34.234418 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:34.234424 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:34.234492 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:06.234474581 +0000 UTC m=+99.745890390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:56:34.234688 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:56:34.234510 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:06.234502502 +0000 UTC m=+99.745918290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:56:35.764921 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:35.764887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:35.865504 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:35.865469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:36.102451 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:36.102410 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:36.199451 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:36.199411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:36.214632 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:36.214596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq4cd" event={"ID":"dffd43c1-cd44-44f8-afc6-8964394659c8","Type":"ContainerStarted","Data":"ea00fa9b6f5216758c52c682aac8986c7ffea1b7cdc20443e57be7d033408d6a"} Jun 13 00:56:36.214760 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:36.214727 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:56:36.231688 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:36.231507 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mq4cd" podStartSLOduration=67.286242013 podStartE2EDuration="1m10.231486612s" totalImagesPullingTime="2.945244599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:36.230986695 +0000 UTC m=+69.742402530" watchObservedRunningTime="2026-06-13 00:56:36.231486612 +0000 UTC m=+69.742902422" Jun 13 00:56:39.224458 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:39.224417 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvstp" event={"ID":"c6eaa436-6a21-4837-a427-6cbdaae027c7","Type":"ContainerStarted","Data":"c2b4e29f87bfb867530137d4166ad246cd0bcdb9cedd162d2744504b1aac8672"} Jun 13 00:56:39.240216 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:39.240141 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvstp" podStartSLOduration=66.829630082 podStartE2EDuration="1m12.240125526s" totalImagesPullingTime="5.410495444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:39.239688634 +0000 UTC m=+72.751104446" watchObservedRunningTime="2026-06-13 00:56:39.240125526 +0000 UTC m=+72.751541335" Jun 13 00:56:54.691840 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:54.691804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:56:54.757532 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:56:54.757496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:57:06.258087 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:57:06.258053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:57:06.258126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:06.258224 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:06.258243 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:06.258272 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:06.258313 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:10.258298473 +0000 UTC m=+163.769714260 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:57:06.258502 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:06.258328 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:10.258321749 +0000 UTC m=+163.769737536 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:57:07.220265 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:57:07.220234 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mq4cd" Jun 13 00:57:36.659947 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:57:36.659908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:57:36.660429 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:36.660043 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 00:57:36.660429 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:57:36.660102 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 00:59:38.660088003 +0000 UTC m=+252.171503793 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : secret "metrics-daemon-secret" not found Jun 13 00:58:05.358789 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:05.358733 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" Jun 13 00:58:05.384910 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:05.384877 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rw8dv" podUID="b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44" Jun 13 00:58:05.428794 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:05.428766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw8dv" Jun 13 00:58:05.428953 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:05.428938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:58:06.942490 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:06.942457 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 00:58:10.288571 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:10.288485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 00:58:10.288571 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:10.288540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 00:58:10.289028 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:10.288632 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 00:58:10.289028 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:10.288642 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656bc68cd7-hdph8: secret "image-registry-tls" not found Jun 13 00:58:10.289028 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:10.288648 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:58:10.289028 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:10.288693 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls podName:4d0fd0f5-4b63-4d8a-96c3-ce05d9616846 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:12.288679307 +0000 UTC m=+285.800095094 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls") pod "image-registry-656bc68cd7-hdph8" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846") : secret "image-registry-tls" not found Jun 13 00:58:10.289028 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:58:10.288706 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls podName:b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:12.288699974 +0000 UTC m=+285.800115760 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls") pod "dns-default-rw8dv" (UID: "b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44") : secret "dns-default-metrics-tls" not found Jun 13 00:58:18.886235 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:18.886202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:58:38.578211 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:38.578138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:45.880881 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:58:45.880843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:22.091682 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:22.091636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:22.193806 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:22.193778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:38.687714 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:38.687678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 00:59:38.688107 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:38.687853 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 00:59:38.688107 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:38.687935 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs podName:aac28d23-ca23-4c9b-ae46-c91e02fb5d27 nodeName:}" failed. No retries permitted until 2026-06-13 01:01:40.68791956 +0000 UTC m=+374.199335346 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs") pod "network-metrics-daemon-mrtvs" (UID: "aac28d23-ca23-4c9b-ae46-c91e02fb5d27") : secret "metrics-daemon-secret" not found Jun 13 00:59:57.774247 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.774137 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b"] Jun 13 00:59:57.777349 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.777313 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-whh4d"] Jun 13 00:59:57.777531 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.777441 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:57.780538 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.780502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" Jun 13 00:59:57.790037 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.790006 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 13 00:59:57.790749 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.790719 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.790910 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.790893 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 13 00:59:57.791645 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.791620 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.793110 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.793080 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kvppc\"" Jun 13 00:59:57.793337 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.793318 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lbbnc\"" Jun 13 00:59:57.797290 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.797245 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p7w9k"] Jun 13 00:59:57.800522 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.800469 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-zl5rr"] Jun 13 00:59:57.800754 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.800632 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.803422 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.803393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:57.813022 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.812996 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 13 00:59:57.813203 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813161 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.813203 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813198 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 13 00:59:57.813329 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813288 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.813392 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.813433 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813424 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wn9wq\"" Jun 13 00:59:57.813525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813505 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.813599 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813585 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 13 00:59:57.813694 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.813678 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 13 00:59:57.816865 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.816851 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8nll9\"" Jun 13 00:59:57.820672 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.820645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b"] Jun 13 00:59:57.821722 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.821703 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-whh4d"] Jun 13 00:59:57.830217 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.830197 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-zl5rr"] Jun 13 00:59:57.834215 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.834197 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 13 00:59:57.837546 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.837529 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 13 00:59:57.839324 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.839304 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p7w9k"] Jun 13 00:59:57.879525 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.879495 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf"] Jun 13 00:59:57.882374 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.882358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:57.884876 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.884852 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.885888 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.885866 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-m5g5w"] Jun 13 00:59:57.886438 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.886421 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dgnvn\"" Jun 13 00:59:57.886520 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.886427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 13 00:59:57.886683 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.886662 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 13 00:59:57.887017 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.886998 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.888669 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.888649 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh"] Jun 13 00:59:57.888768 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.888753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:57.892400 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.892385 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-647b4987fd-8bpv2"] Jun 13 00:59:57.892491 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.892476 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" Jun 13 00:59:57.893069 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.892977 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 13 00:59:57.893069 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.893003 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 13 00:59:57.893277 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.893053 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qxkhh\"" Jun 13 00:59:57.895228 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.895211 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.895327 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.895281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.895327 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.895321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:57.895898 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.895879 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x6bpr\"" Jun 13 00:59:57.896403 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.896387 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf"] Jun 13 00:59:57.900461 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.900445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 13 00:59:57.900632 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.900605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.901076 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.901060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 13 00:59:57.901146 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.901125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5rjt8\"" Jun 13 00:59:57.901268 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.901255 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 13 00:59:57.901311 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.901303 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.901571 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.901558 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 13 00:59:57.905816 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.905797 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh"] Jun 13 00:59:57.919496 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.919476 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-647b4987fd-8bpv2"] Jun 13 00:59:57.920390 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.920368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-m5g5w"] Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-tmp\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927360 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc9b2b19-72ce-4da3-96ba-90853666be05-serving-cert\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-trusted-ca\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47c5a238-e76a-4415-a56e-551031ad3420-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47c5a238-e76a-4415-a56e-551031ad3420-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927545 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2l29\" (UniqueName: \"kubernetes.io/projected/47c5a238-e76a-4415-a56e-551031ad3420-kube-api-access-p2l29\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcv9d\" (UniqueName: \"kubernetes.io/projected/fc9b2b19-72ce-4da3-96ba-90853666be05-kube-api-access-dcv9d\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k6mv\" (UniqueName: \"kubernetes.io/projected/5b370a52-643d-472d-ba46-a8d5f74e398c-kube-api-access-9k6mv\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4nx4\" (UniqueName: \"kubernetes.io/projected/35debd8f-8e1f-4d36-a523-606afde6f1df-kube-api-access-s4nx4\") pod \"network-check-source-6947749cfc-whh4d\" (UID: \"35debd8f-8e1f-4d36-a523-606afde6f1df\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b370a52-643d-472d-ba46-a8d5f74e398c-serving-cert\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-snapshots\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:57.930686 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.927835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-config\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:57.984383 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.984348 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2"] Jun 13 00:59:57.987337 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.987322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:57.990187 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.990156 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 13 00:59:57.990718 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.990677 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:59:57.990831 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.990735 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 13 00:59:57.990831 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:57.990750 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vr82v\"" Jun 13 00:59:58.002522 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.002504 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2"] Jun 13 00:59:58.028983 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.028966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-stats-auth\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.029073 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.028996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029073 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3594a1fd-797f-4f32-acc1-c3535334a444-nginx-conf\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.029073 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b370a52-643d-472d-ba46-a8d5f74e398c-serving-cert\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029191 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-snapshots\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029191 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-config\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.029292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-tmp\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc9b2b19-72ce-4da3-96ba-90853666be05-serving-cert\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.029292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029246 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029292 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xj2\" (UniqueName: \"kubernetes.io/projected/2d315867-6864-4f4b-8f02-09e0f7835846-kube-api-access-t4xj2\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.029459 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w68wh\" (UniqueName: \"kubernetes.io/projected/5a5ca467-4268-4c15-b554-8655e2cd58cb-kube-api-access-w68wh\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.029553 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-trusted-ca\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.029671 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.029671 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d315867-6864-4f4b-8f02-09e0f7835846-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.029671 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029603 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029671 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d315867-6864-4f4b-8f02-09e0f7835846-config\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kp6\" (UniqueName: \"kubernetes.io/projected/6e30ec7d-b0da-4659-bc8c-ed49c7022075-kube-api-access-b9kp6\") pod \"volume-data-source-validator-bd4ccd799-67bgh\" (UID: \"6e30ec7d-b0da-4659-bc8c-ed49c7022075\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47c5a238-e76a-4415-a56e-551031ad3420-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47c5a238-e76a-4415-a56e-551031ad3420-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-snapshots\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2l29\" (UniqueName: \"kubernetes.io/projected/47c5a238-e76a-4415-a56e-551031ad3420-kube-api-access-p2l29\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.029884 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcv9d\" (UniqueName: \"kubernetes.io/projected/fc9b2b19-72ce-4da3-96ba-90853666be05-kube-api-access-dcv9d\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k6mv\" (UniqueName: \"kubernetes.io/projected/5b370a52-643d-472d-ba46-a8d5f74e398c-kube-api-access-9k6mv\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-default-certificate\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.030021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4nx4\" (UniqueName: \"kubernetes.io/projected/35debd8f-8e1f-4d36-a523-606afde6f1df-kube-api-access-s4nx4\") pod \"network-check-source-6947749cfc-whh4d\" (UID: \"35debd8f-8e1f-4d36-a523-606afde6f1df\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.030196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b370a52-643d-472d-ba46-a8d5f74e398c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.030245 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.029783 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-config\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.030628 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.030325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47c5a238-e76a-4415-a56e-551031ad3420-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.030628 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.030439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc9b2b19-72ce-4da3-96ba-90853666be05-trusted-ca\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.030628 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.030583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b370a52-643d-472d-ba46-a8d5f74e398c-tmp\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.032050 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.032028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b370a52-643d-472d-ba46-a8d5f74e398c-serving-cert\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.032329 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.032307 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47c5a238-e76a-4415-a56e-551031ad3420-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.032398 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.032354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc9b2b19-72ce-4da3-96ba-90853666be05-serving-cert\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.044725 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.044695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcv9d\" (UniqueName: \"kubernetes.io/projected/fc9b2b19-72ce-4da3-96ba-90853666be05-kube-api-access-dcv9d\") pod \"console-operator-5dbbb5d744-zl5rr\" (UID: \"fc9b2b19-72ce-4da3-96ba-90853666be05\") " pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.048043 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.048014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4nx4\" (UniqueName: \"kubernetes.io/projected/35debd8f-8e1f-4d36-a523-606afde6f1df-kube-api-access-s4nx4\") pod \"network-check-source-6947749cfc-whh4d\" (UID: \"35debd8f-8e1f-4d36-a523-606afde6f1df\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" Jun 13 00:59:58.048690 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.048665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2l29\" (UniqueName: \"kubernetes.io/projected/47c5a238-e76a-4415-a56e-551031ad3420-kube-api-access-p2l29\") pod \"kube-storage-version-migrator-operator-7c578b78fc-jp48b\" (UID: \"47c5a238-e76a-4415-a56e-551031ad3420\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.050381 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.050364 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k6mv\" (UniqueName: \"kubernetes.io/projected/5b370a52-643d-472d-ba46-a8d5f74e398c-kube-api-access-9k6mv\") pod \"insights-operator-5bbd86d6bd-p7w9k\" (UID: \"5b370a52-643d-472d-ba46-a8d5f74e398c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.090198 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.090151 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" Jun 13 00:59:58.097215 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.097199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" Jun 13 00:59:58.111322 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.111294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" Jun 13 00:59:58.117390 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.117358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-default-certificate\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6kl4\" (UniqueName: \"kubernetes.io/projected/c80afca8-5283-4ac6-b156-2834c4078dc4-kube-api-access-f6kl4\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-stats-auth\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3594a1fd-797f-4f32-acc1-c3535334a444-nginx-conf\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xj2\" (UniqueName: \"kubernetes.io/projected/2d315867-6864-4f4b-8f02-09e0f7835846-kube-api-access-t4xj2\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w68wh\" (UniqueName: \"kubernetes.io/projected/5a5ca467-4268-4c15-b554-8655e2cd58cb-kube-api-access-w68wh\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d315867-6864-4f4b-8f02-09e0f7835846-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d315867-6864-4f4b-8f02-09e0f7835846-config\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kp6\" (UniqueName: \"kubernetes.io/projected/6e30ec7d-b0da-4659-bc8c-ed49c7022075-kube-api-access-b9kp6\") pod \"volume-data-source-validator-bd4ccd799-67bgh\" (UID: \"6e30ec7d-b0da-4659-bc8c-ed49c7022075\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.130917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.131048 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 00:59:58.131774 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.131119 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 00:59:58.631097864 +0000 UTC m=+272.142513671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : secret "router-metrics-certs-default" not found Jun 13 00:59:58.132624 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.132418 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 00:59:58.132624 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.132486 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 00:59:58.632467728 +0000 UTC m=+272.143883529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 00:59:58.132624 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.132565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 00:59:58.632555376 +0000 UTC m=+272.143971183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : configmap references non-existent config key: service-ca.crt Jun 13 00:59:58.132993 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.132943 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3594a1fd-797f-4f32-acc1-c3535334a444-nginx-conf\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.133305 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.133281 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d315867-6864-4f4b-8f02-09e0f7835846-config\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.134479 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.134451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-default-certificate\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.136223 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.136181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d315867-6864-4f4b-8f02-09e0f7835846-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.136382 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.136359 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-stats-auth\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.149476 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.148946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xj2\" (UniqueName: \"kubernetes.io/projected/2d315867-6864-4f4b-8f02-09e0f7835846-kube-api-access-t4xj2\") pod \"service-ca-operator-7ccbfd59dc-rmmgf\" (UID: \"2d315867-6864-4f4b-8f02-09e0f7835846\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.151253 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.151198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kp6\" (UniqueName: \"kubernetes.io/projected/6e30ec7d-b0da-4659-bc8c-ed49c7022075-kube-api-access-b9kp6\") pod \"volume-data-source-validator-bd4ccd799-67bgh\" (UID: \"6e30ec7d-b0da-4659-bc8c-ed49c7022075\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" Jun 13 00:59:58.152287 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.152163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w68wh\" (UniqueName: \"kubernetes.io/projected/5a5ca467-4268-4c15-b554-8655e2cd58cb-kube-api-access-w68wh\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.180536 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.180473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:58.194537 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.194098 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" Jun 13 00:59:58.207922 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.207725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" Jun 13 00:59:58.232986 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.232344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6kl4\" (UniqueName: \"kubernetes.io/projected/c80afca8-5283-4ac6-b156-2834c4078dc4-kube-api-access-f6kl4\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.232986 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.232392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.232986 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.232669 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 00:59:58.232986 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.232733 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls podName:c80afca8-5283-4ac6-b156-2834c4078dc4 nodeName:}" failed. No retries permitted until 2026-06-13 00:59:58.73271339 +0000 UTC m=+272.244129192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-772c2" (UID: "c80afca8-5283-4ac6-b156-2834c4078dc4") : secret "samples-operator-tls" not found Jun 13 00:59:58.245276 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.245219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6kl4\" (UniqueName: \"kubernetes.io/projected/c80afca8-5283-4ac6-b156-2834c4078dc4-kube-api-access-f6kl4\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.269464 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.269425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b"] Jun 13 00:59:58.273929 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.273871 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c5a238_e76a_4415_a56e_551031ad3420.slice/crio-06a409ba52e439ab2dfd45b65f9677b026df66f1500d76d89510f270894aefb8 WatchSource:0}: Error finding container 06a409ba52e439ab2dfd45b65f9677b026df66f1500d76d89510f270894aefb8: Status 404 returned error can't find the container with id 06a409ba52e439ab2dfd45b65f9677b026df66f1500d76d89510f270894aefb8 Jun 13 00:59:58.280234 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.280123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:58.292795 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.292759 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-whh4d"] Jun 13 00:59:58.300706 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.300676 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35debd8f_8e1f_4d36_a523_606afde6f1df.slice/crio-cadfa61e7251ca08c9ced55326bc891707af066192fd2935e4818ed47ad2bbcf WatchSource:0}: Error finding container cadfa61e7251ca08c9ced55326bc891707af066192fd2935e4818ed47ad2bbcf: Status 404 returned error can't find the container with id cadfa61e7251ca08c9ced55326bc891707af066192fd2935e4818ed47ad2bbcf Jun 13 00:59:58.319038 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.319011 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p7w9k"] Jun 13 00:59:58.322925 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.322891 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b370a52_643d_472d_ba46_a8d5f74e398c.slice/crio-5bc6701519f5383b2029507c5456c272089c579f74f3e05ee9328723d01b9330 WatchSource:0}: Error finding container 5bc6701519f5383b2029507c5456c272089c579f74f3e05ee9328723d01b9330: Status 404 returned error can't find the container with id 5bc6701519f5383b2029507c5456c272089c579f74f3e05ee9328723d01b9330 Jun 13 00:59:58.363809 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.363785 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf"] Jun 13 00:59:58.366293 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.366269 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d315867_6864_4f4b_8f02_09e0f7835846.slice/crio-13613b44392f7a571d3f1a1b134c3b7487ba2ebf32bf81de2eaef63c55177394 WatchSource:0}: Error finding container 13613b44392f7a571d3f1a1b134c3b7487ba2ebf32bf81de2eaef63c55177394: Status 404 returned error can't find the container with id 13613b44392f7a571d3f1a1b134c3b7487ba2ebf32bf81de2eaef63c55177394 Jun 13 00:59:58.386619 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.386594 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh"] Jun 13 00:59:58.387799 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.387774 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e30ec7d_b0da_4659_bc8c_ed49c7022075.slice/crio-d1bc785703cd9962b0c7b2ce75281902d7ae32b64617a15a3a6a88b3a43770f5 WatchSource:0}: Error finding container d1bc785703cd9962b0c7b2ce75281902d7ae32b64617a15a3a6a88b3a43770f5: Status 404 returned error can't find the container with id d1bc785703cd9962b0c7b2ce75281902d7ae32b64617a15a3a6a88b3a43770f5 Jun 13 00:59:58.511438 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.511408 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-zl5rr"] Jun 13 00:59:58.514744 ip-10-0-140-23 kubenswrapper[2558]: W0613 00:59:58.514696 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9b2b19_72ce_4da3_96ba_90853666be05.slice/crio-2187ceb5ee50324507641e94f82d0c41283f4010db6f94aa95e73b0c26f2d474 WatchSource:0}: Error finding container 2187ceb5ee50324507641e94f82d0c41283f4010db6f94aa95e73b0c26f2d474: Status 404 returned error can't find the container with id 2187ceb5ee50324507641e94f82d0c41283f4010db6f94aa95e73b0c26f2d474 Jun 13 00:59:58.637128 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.637045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.637128 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.637099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:58.637331 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.637201 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 00:59:58.637331 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.637212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:58.637331 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.637279 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 00:59:58.637331 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.637281 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 00:59:59.637253557 +0000 UTC m=+273.148669345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : secret "router-metrics-certs-default" not found Jun 13 00:59:58.637458 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.637342 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 00:59:59.637315926 +0000 UTC m=+273.148731712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : configmap references non-existent config key: service-ca.crt Jun 13 00:59:58.637458 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.637367 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 00:59:59.637358013 +0000 UTC m=+273.148773801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 00:59:58.697084 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.697041 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" event={"ID":"fc9b2b19-72ce-4da3-96ba-90853666be05","Type":"ContainerStarted","Data":"2187ceb5ee50324507641e94f82d0c41283f4010db6f94aa95e73b0c26f2d474"} Jun 13 00:59:58.698208 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.698152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" event={"ID":"2d315867-6864-4f4b-8f02-09e0f7835846","Type":"ContainerStarted","Data":"13613b44392f7a571d3f1a1b134c3b7487ba2ebf32bf81de2eaef63c55177394"} Jun 13 00:59:58.699299 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.699276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" event={"ID":"5b370a52-643d-472d-ba46-a8d5f74e398c","Type":"ContainerStarted","Data":"5bc6701519f5383b2029507c5456c272089c579f74f3e05ee9328723d01b9330"} Jun 13 00:59:58.700426 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.700404 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" event={"ID":"47c5a238-e76a-4415-a56e-551031ad3420","Type":"ContainerStarted","Data":"06a409ba52e439ab2dfd45b65f9677b026df66f1500d76d89510f270894aefb8"} Jun 13 00:59:58.701491 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.701465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" event={"ID":"6e30ec7d-b0da-4659-bc8c-ed49c7022075","Type":"ContainerStarted","Data":"d1bc785703cd9962b0c7b2ce75281902d7ae32b64617a15a3a6a88b3a43770f5"} Jun 13 00:59:58.702952 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.702933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" event={"ID":"35debd8f-8e1f-4d36-a523-606afde6f1df","Type":"ContainerStarted","Data":"9787667aa5e3f4d8da05783b24dd979d6cdf1b1c925615fdf42c77aa2d5cb307"} Jun 13 00:59:58.703034 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.702965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" event={"ID":"35debd8f-8e1f-4d36-a523-606afde6f1df","Type":"ContainerStarted","Data":"cadfa61e7251ca08c9ced55326bc891707af066192fd2935e4818ed47ad2bbcf"} Jun 13 00:59:58.723594 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.723513 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-whh4d" podStartSLOduration=1.723490094 podStartE2EDuration="1.723490094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:59:58.722653931 +0000 UTC m=+272.234069741" watchObservedRunningTime="2026-06-13 00:59:58.723490094 +0000 UTC m=+272.234905881" Jun 13 00:59:58.738441 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:58.738373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:58.738733 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.738559 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 00:59:58.738733 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:58.738673 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls podName:c80afca8-5283-4ac6-b156-2834c4078dc4 nodeName:}" failed. No retries permitted until 2026-06-13 00:59:59.738643697 +0000 UTC m=+273.250059488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-772c2" (UID: "c80afca8-5283-4ac6-b156-2834c4078dc4") : secret "samples-operator-tls" not found Jun 13 00:59:59.646746 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:59.646708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:59.646775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:59.646869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.647042 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.647115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:01.647093973 +0000 UTC m=+275.158509769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.647203 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.647242 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:01.647229928 +0000 UTC m=+275.158645715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : secret "router-metrics-certs-default" not found Jun 13 00:59:59.647340 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.647306 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:01.647296286 +0000 UTC m=+275.158712074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : configmap references non-existent config key: service-ca.crt Jun 13 00:59:59.748988 ip-10-0-140-23 kubenswrapper[2558]: I0613 00:59:59.747945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 00:59:59.748988 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.748153 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 00:59:59.748988 ip-10-0-140-23 kubenswrapper[2558]: E0613 00:59:59.748241 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls podName:c80afca8-5283-4ac6-b156-2834c4078dc4 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:01.748220485 +0000 UTC m=+275.259636277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-772c2" (UID: "c80afca8-5283-4ac6-b156-2834c4078dc4") : secret "samples-operator-tls" not found Jun 13 01:00:00.714041 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:00.713998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" event={"ID":"6e30ec7d-b0da-4659-bc8c-ed49c7022075","Type":"ContainerStarted","Data":"fb8b86d8726a3ec1b10f587b6bb31690fb5f0c08862db61b3acbb4e2e1d49f3a"} Jun 13 01:00:00.805630 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:00.805587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:00.858672 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:00.858637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:01.663955 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:01.663899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:01.664149 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:01.663976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:01.664149 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.664048 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:00:01.664149 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:01.664086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:01.664149 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.664121 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.664103094 +0000 UTC m=+279.175518884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : configmap references non-existent config key: service-ca.crt Jun 13 01:00:01.664149 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.664149 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.664138326 +0000 UTC m=+279.175554114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : secret "router-metrics-certs-default" not found Jun 13 01:00:01.664402 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.664211 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:00:01.664402 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.664272 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.664256159 +0000 UTC m=+279.175671961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 01:00:01.765453 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:01.765377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 01:00:01.765895 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.765495 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:00:01.765895 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:01.765574 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls podName:c80afca8-5283-4ac6-b156-2834c4078dc4 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.765553319 +0000 UTC m=+279.276969110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-772c2" (UID: "c80afca8-5283-4ac6-b156-2834c4078dc4") : secret "samples-operator-tls" not found Jun 13 01:00:02.723419 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.723384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/0.log" Jun 13 01:00:02.723623 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.723436 2558 generic.go:356] "Generic (PLEG): container finished" podID="fc9b2b19-72ce-4da3-96ba-90853666be05" containerID="e6c0165e98b6eb36c267f343f2a1cdf9f9edabeee3442cdd3bec305092e4c111" exitCode=255 Jun 13 01:00:02.723623 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.723529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" event={"ID":"fc9b2b19-72ce-4da3-96ba-90853666be05","Type":"ContainerDied","Data":"e6c0165e98b6eb36c267f343f2a1cdf9f9edabeee3442cdd3bec305092e4c111"} Jun 13 01:00:02.723752 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.723734 2558 scope.go:117] "RemoveContainer" containerID="e6c0165e98b6eb36c267f343f2a1cdf9f9edabeee3442cdd3bec305092e4c111" Jun 13 01:00:02.725483 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.725455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" event={"ID":"2d315867-6864-4f4b-8f02-09e0f7835846","Type":"ContainerStarted","Data":"76394beeb162e5652e5282996d46b952b1ec5fb38f4e714568a77880dd26fb39"} Jun 13 01:00:02.727133 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.727108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" event={"ID":"5b370a52-643d-472d-ba46-a8d5f74e398c","Type":"ContainerStarted","Data":"f71e83dd2f81deaadea17a89ac9735c0e8707ab52ba985661e9ed9416fb1c4d8"} Jun 13 01:00:02.728821 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.728796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" event={"ID":"47c5a238-e76a-4415-a56e-551031ad3420","Type":"ContainerStarted","Data":"dedb0860156bbc0059c1f7df969574b06929333a78b5bc9d5fe72fd2b88ade19"} Jun 13 01:00:02.738576 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.738523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-67bgh" podStartSLOduration=4.287493186 podStartE2EDuration="5.738503356s" totalImagesPullingTime="1.45101017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:00.730390233 +0000 UTC m=+274.241806043" watchObservedRunningTime="2026-06-13 01:00:02.738503356 +0000 UTC m=+276.249919170" Jun 13 01:00:02.755624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.755569 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" podStartSLOduration=1.9600354690000001 podStartE2EDuration="5.755548654s" totalImagesPullingTime="3.795513185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:02.754759066 +0000 UTC m=+276.266174875" watchObservedRunningTime="2026-06-13 01:00:02.755548654 +0000 UTC m=+276.266964445" Jun 13 01:00:02.768995 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.768941 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" podStartSLOduration=1.88254936 podStartE2EDuration="5.768919755s" totalImagesPullingTime="3.886370395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:02.767894446 +0000 UTC m=+276.279310255" watchObservedRunningTime="2026-06-13 01:00:02.768919755 +0000 UTC m=+276.280335567" Jun 13 01:00:02.787045 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:02.785931 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" podStartSLOduration=1.943213938 podStartE2EDuration="5.785911184s" totalImagesPullingTime="3.842697246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:02.784455673 +0000 UTC m=+276.295871483" watchObservedRunningTime="2026-06-13 01:00:02.785911184 +0000 UTC m=+276.297326995" Jun 13 01:00:03.437993 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.437955 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:03.506282 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.506246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:03.733681 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.733609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:00:03.734081 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.734062 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/0.log" Jun 13 01:00:03.734223 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.734103 2558 generic.go:356] "Generic (PLEG): container finished" podID="fc9b2b19-72ce-4da3-96ba-90853666be05" containerID="44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e" exitCode=255 Jun 13 01:00:03.734223 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.734212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" event={"ID":"fc9b2b19-72ce-4da3-96ba-90853666be05","Type":"ContainerDied","Data":"44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e"} Jun 13 01:00:03.734320 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.734280 2558 scope.go:117] "RemoveContainer" containerID="e6c0165e98b6eb36c267f343f2a1cdf9f9edabeee3442cdd3bec305092e4c111" Jun 13 01:00:03.734612 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.734593 2558 scope.go:117] "RemoveContainer" containerID="44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e" Jun 13 01:00:03.734812 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:03.734788 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-zl5rr_openshift-console-operator(fc9b2b19-72ce-4da3-96ba-90853666be05)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" podUID="fc9b2b19-72ce-4da3-96ba-90853666be05" Jun 13 01:00:03.875913 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.875872 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vkrz6"] Jun 13 01:00:03.880725 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.880691 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:03.883649 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.883623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 01:00:03.883880 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.883856 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 01:00:03.883991 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.883902 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5t7j8\"" Jun 13 01:00:03.890878 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.890847 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vkrz6"] Jun 13 01:00:03.920377 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.920341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:03.985562 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.985473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:03.986484 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.986462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgm29\" (UniqueName: \"kubernetes.io/projected/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-api-access-tgm29\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:03.986596 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.986506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:03.986596 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.986533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c60aa0b8-83f3-46df-97b7-4a53293131a3-crio-socket\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:03.986596 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.986558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60aa0b8-83f3-46df-97b7-4a53293131a3-data-volume\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:03.986696 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:03.986635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087490 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087639 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgm29\" (UniqueName: \"kubernetes.io/projected/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-api-access-tgm29\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087639 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087746 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c60aa0b8-83f3-46df-97b7-4a53293131a3-crio-socket\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087746 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60aa0b8-83f3-46df-97b7-4a53293131a3-data-volume\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087746 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.087718 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.087852 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.087755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c60aa0b8-83f3-46df-97b7-4a53293131a3-crio-socket\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.087852 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.087782 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:04.587761345 +0000 UTC m=+278.099177133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.087852 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.087823 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:04.087950 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.087877 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:04.587864114 +0000 UTC m=+278.099279905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : configmap "kube-rbac-proxy" not found Jun 13 01:00:04.088059 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.088043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c60aa0b8-83f3-46df-97b7-4a53293131a3-data-volume\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.108665 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.108637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgm29\" (UniqueName: \"kubernetes.io/projected/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-api-access-tgm29\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.186079 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.186044 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:04.239741 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.239651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:04.591732 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.591695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.591892 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.591782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:04.591892 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.591844 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.591892 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.591855 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:04.592001 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.591909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.591893843 +0000 UTC m=+279.103309633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.592001 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.591925 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.591918084 +0000 UTC m=+279.103333870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : configmap "kube-rbac-proxy" not found Jun 13 01:00:04.738690 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.738664 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:00:04.739020 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:04.739004 2558 scope.go:117] "RemoveContainer" containerID="44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e" Jun 13 01:00:04.739188 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:04.739151 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-zl5rr_openshift-console-operator(fc9b2b19-72ce-4da3-96ba-90853666be05)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" podUID="fc9b2b19-72ce-4da3-96ba-90853666be05" Jun 13 01:00:05.191253 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.191223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:05.249847 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.249820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:05.599352 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.599318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:05.599535 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.599440 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:05.599535 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.599439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:05.599535 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.599509 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:07.599494302 +0000 UTC m=+281.110910092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : configmap "kube-rbac-proxy" not found Jun 13 01:00:05.599703 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.599574 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:05.599703 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.599633 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:07.599617781 +0000 UTC m=+281.111033583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:05.673386 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.673362 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpjtl_543185f8-be1e-40cb-9d02-77f63b0dfb0d/dns-node-resolver/0.log" Jun 13 01:00:05.700110 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.700078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:05.700275 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.700146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:05.700275 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.700210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:05.700275 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.700252 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:00:05.700415 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.700276 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:00:05.700415 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.700329 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:13.700313561 +0000 UTC m=+287.211729349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : secret "router-metrics-certs-default" not found Jun 13 01:00:05.700415 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.700344 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:13.700337044 +0000 UTC m=+287.211752831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 01:00:05.700415 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.700354 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle podName:5a5ca467-4268-4c15-b554-8655e2cd58cb nodeName:}" failed. No retries permitted until 2026-06-13 01:00:13.700348552 +0000 UTC m=+287.211764338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle") pod "router-default-647b4987fd-8bpv2" (UID: "5a5ca467-4268-4c15-b554-8655e2cd58cb") : configmap references non-existent config key: service-ca.crt Jun 13 01:00:05.743027 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.742997 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-rtqdm"] Jun 13 01:00:05.746112 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.746094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.748223 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.748205 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 13 01:00:05.748964 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.748948 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 13 01:00:05.749051 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.749007 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 13 01:00:05.749286 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.749270 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 13 01:00:05.749358 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.749336 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-h5rk8\"" Jun 13 01:00:05.755582 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.755562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-rtqdm"] Jun 13 01:00:05.785206 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.785164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:05.801587 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.801567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7cp5\" (UniqueName: \"kubernetes.io/projected/6caa4a26-34fb-47ad-9cb8-e60316a216d0-kube-api-access-h7cp5\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.801664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.801634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 01:00:05.801700 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.801685 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-key\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.801735 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.801724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-cabundle\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.801765 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.801754 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:00:05.801819 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:05.801804 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls podName:c80afca8-5283-4ac6-b156-2834c4078dc4 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:13.801790106 +0000 UTC m=+287.313205903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-772c2" (UID: "c80afca8-5283-4ac6-b156-2834c4078dc4") : secret "samples-operator-tls" not found Jun 13 01:00:05.848801 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.848772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:05.902581 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.902523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7cp5\" (UniqueName: \"kubernetes.io/projected/6caa4a26-34fb-47ad-9cb8-e60316a216d0-kube-api-access-h7cp5\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.902674 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.902639 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-key\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.902715 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.902672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-cabundle\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.903331 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.903310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-cabundle\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.905069 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.905050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6caa4a26-34fb-47ad-9cb8-e60316a216d0-signing-key\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:05.910115 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:05.910099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7cp5\" (UniqueName: \"kubernetes.io/projected/6caa4a26-34fb-47ad-9cb8-e60316a216d0-kube-api-access-h7cp5\") pod \"service-ca-7b994bc59-rtqdm\" (UID: \"6caa4a26-34fb-47ad-9cb8-e60316a216d0\") " pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:06.055129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.055089 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" Jun 13 01:00:06.185341 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.185271 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-rtqdm"] Jun 13 01:00:06.188358 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:06.188328 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6caa4a26_34fb_47ad_9cb8_e60316a216d0.slice/crio-497c5ff17a5751bc94c05467e62c075cbdd30431abe72400b509a2eedf5de0ee WatchSource:0}: Error finding container 497c5ff17a5751bc94c05467e62c075cbdd30431abe72400b509a2eedf5de0ee: Status 404 returned error can't find the container with id 497c5ff17a5751bc94c05467e62c075cbdd30431abe72400b509a2eedf5de0ee Jun 13 01:00:06.746877 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.746843 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" event={"ID":"6caa4a26-34fb-47ad-9cb8-e60316a216d0","Type":"ContainerStarted","Data":"4cebc065d2c591c84a253e25f1664bfec670891c473f7575a928a3e9b68a7447"} Jun 13 01:00:06.747332 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.746888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" event={"ID":"6caa4a26-34fb-47ad-9cb8-e60316a216d0","Type":"ContainerStarted","Data":"497c5ff17a5751bc94c05467e62c075cbdd30431abe72400b509a2eedf5de0ee"} Jun 13 01:00:06.770125 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.770065 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-rtqdm" podStartSLOduration=1.770043874 podStartE2EDuration="1.770043874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:06.768815774 +0000 UTC m=+280.280231580" watchObservedRunningTime="2026-06-13 01:00:06.770043874 +0000 UTC m=+280.281459685" Jun 13 01:00:06.930272 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:06.930232 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:07.073823 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.073798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5m6t_6b0b1203-9b43-418d-baa0-29f565f17edb/node-ca/0.log" Jun 13 01:00:07.278868 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.278833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:07.441797 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.441604 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:07.473314 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.473280 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-247nk_cee7da03-acd7-4363-8c7d-cdc00c3faa1c/serve-healthcheck-canary/0.log" Jun 13 01:00:07.616881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.616833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:07.617090 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.616962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:07.617090 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:07.616998 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:07.617090 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:07.617060 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:07.617090 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:07.617081 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:11.617057148 +0000 UTC m=+285.128472949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:07.617335 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:07.617112 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:11.617095489 +0000 UTC m=+285.128511283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : configmap "kube-rbac-proxy" not found Jun 13 01:00:07.727541 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.727459 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:07.932519 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:07.932481 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:08.034352 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.034304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:08.117803 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.117770 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 01:00:08.117951 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.117873 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 01:00:08.118324 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.118309 2558 scope.go:117] "RemoveContainer" containerID="44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e" Jun 13 01:00:08.118526 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:08.118505 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-zl5rr_openshift-console-operator(fc9b2b19-72ce-4da3-96ba-90853666be05)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" podUID="fc9b2b19-72ce-4da3-96ba-90853666be05" Jun 13 01:00:08.383853 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.383756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:08.429588 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:08.429549 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rw8dv" podUID="b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44" Jun 13 01:00:08.429719 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:08.429604 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" Jun 13 01:00:08.754332 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.754254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:08.754332 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:08.754282 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:09.582537 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:09.582502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:09.780876 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:09.780847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:09.974142 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:09.974063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:10.176809 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:10.176781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:10.390481 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:10.390446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:10.803872 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:10.803836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:11.181352 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.181273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:11.254433 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.254402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:11.390111 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.390079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:11.602851 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.602817 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:11.652032 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.651998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:11.652218 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:11.652114 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:11.652291 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:11.652222 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:11.652291 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.652113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:11.652291 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:11.652240 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:19.652218745 +0000 UTC m=+293.163634548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : configmap "kube-rbac-proxy" not found Jun 13 01:00:11.652291 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:11.652291 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls podName:c60aa0b8-83f3-46df-97b7-4a53293131a3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:19.652266035 +0000 UTC m=+293.163681835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkrz6" (UID: "c60aa0b8-83f3-46df-97b7-4a53293131a3") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:11.974140 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:11.974051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:12.180309 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.180276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:12.358517 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.358471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:12.358684 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.358542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:12.360969 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.360936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44-metrics-tls\") pod \"dns-default-rw8dv\" (UID: \"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44\") " pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:12.361085 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.360984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"image-registry-656bc68cd7-hdph8\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:12.580951 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.580923 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:12.657250 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.657156 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rclk4\"" Jun 13 01:00:12.657250 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.657189 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v656w\"" Jun 13 01:00:12.665920 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.665891 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:12.666034 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.665981 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:12.811323 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.811288 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rw8dv"] Jun 13 01:00:12.815817 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:12.815782 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88b81b6_ba3f_4f3d_81f4_7981b9cdfd44.slice/crio-1bc444967ba7ad88046f51b3e0ec1516fa2b2ab5265bf0cf48865dafc98c5c1d WatchSource:0}: Error finding container 1bc444967ba7ad88046f51b3e0ec1516fa2b2ab5265bf0cf48865dafc98c5c1d: Status 404 returned error can't find the container with id 1bc444967ba7ad88046f51b3e0ec1516fa2b2ab5265bf0cf48865dafc98c5c1d Jun 13 01:00:12.830428 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:12.830397 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 01:00:12.833445 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:12.833417 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0fd0f5_4b63_4d8a_96c3_ce05d9616846.slice/crio-e7d618a8555c07c22252f262a520572e3025f057ca07a05be6417141ed0218d2 WatchSource:0}: Error finding container e7d618a8555c07c22252f262a520572e3025f057ca07a05be6417141ed0218d2: Status 404 returned error can't find the container with id e7d618a8555c07c22252f262a520572e3025f057ca07a05be6417141ed0218d2 Jun 13 01:00:13.178125 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.178087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:13.570819 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.570762 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:13.771933 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.771894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:13.772136 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.771991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:13.772136 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.772022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:13.772136 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.772030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:13.772136 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:13.772095 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:00:13.772382 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:13.772197 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert podName:3594a1fd-797f-4f32-acc1-c3535334a444 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:29.772154493 +0000 UTC m=+303.283570291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-m5g5w" (UID: "3594a1fd-797f-4f32-acc1-c3535334a444") : secret "networking-console-plugin-cert" not found Jun 13 01:00:13.772757 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.772733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5ca467-4268-4c15-b554-8655e2cd58cb-service-ca-bundle\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:13.775309 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.775257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a5ca467-4268-4c15-b554-8655e2cd58cb-metrics-certs\") pod \"router-default-647b4987fd-8bpv2\" (UID: \"5a5ca467-4268-4c15-b554-8655e2cd58cb\") " pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:13.775887 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.775861 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw8dv" event={"ID":"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44","Type":"ContainerStarted","Data":"1bc444967ba7ad88046f51b3e0ec1516fa2b2ab5265bf0cf48865dafc98c5c1d"} Jun 13 01:00:13.777805 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.777778 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" event={"ID":"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846","Type":"ContainerStarted","Data":"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3"} Jun 13 01:00:13.777880 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.777829 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" event={"ID":"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846","Type":"ContainerStarted","Data":"e7d618a8555c07c22252f262a520572e3025f057ca07a05be6417141ed0218d2"} Jun 13 01:00:13.778302 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.778247 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:13.796184 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.796122 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" podStartSLOduration=286.796100372 podStartE2EDuration="4m46.796100372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:13.795636138 +0000 UTC m=+287.307051960" watchObservedRunningTime="2026-06-13 01:00:13.796100372 +0000 UTC m=+287.307516182" Jun 13 01:00:13.812116 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.812080 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:13.822101 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.822009 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:13.875089 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.873815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 01:00:13.884551 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.884472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80afca8-5283-4ac6-b156-2834c4078dc4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-772c2\" (UID: \"c80afca8-5283-4ac6-b156-2834c4078dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 01:00:13.898562 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:13.898350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" Jun 13 01:00:14.000823 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.000734 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-647b4987fd-8bpv2"] Jun 13 01:00:14.004682 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:14.004641 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5ca467_4268_4c15_b554_8655e2cd58cb.slice/crio-6f274061f664824af281bb80a5a04262c0ad3ed9da2eb3ab851e2d37fb4fb56e WatchSource:0}: Error finding container 6f274061f664824af281bb80a5a04262c0ad3ed9da2eb3ab851e2d37fb4fb56e: Status 404 returned error can't find the container with id 6f274061f664824af281bb80a5a04262c0ad3ed9da2eb3ab851e2d37fb4fb56e Jun 13 01:00:14.068713 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.068675 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2"] Jun 13 01:00:14.374624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.374575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:14.582023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.581942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:14.783470 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.783431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw8dv" event={"ID":"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44","Type":"ContainerStarted","Data":"c161e2caeb15c30534809174661853f863ee36d324147f1f8f2938f21510b1c6"} Jun 13 01:00:14.783632 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.783485 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw8dv" event={"ID":"b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44","Type":"ContainerStarted","Data":"eb852f43d834f584df3b480f99ac4a4c81e39f235a1bb028aebb0cf398b09beb"} Jun 13 01:00:14.783632 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.783549 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:14.784590 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.784571 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" event={"ID":"c80afca8-5283-4ac6-b156-2834c4078dc4","Type":"ContainerStarted","Data":"79f4db9a7e239b12a6d720b8b0e69c3a04e5a0055c47244e9446abf00daa9193"} Jun 13 01:00:14.786153 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.786122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-647b4987fd-8bpv2" event={"ID":"5a5ca467-4268-4c15-b554-8655e2cd58cb","Type":"ContainerStarted","Data":"190706f6ac19a4b3c9c7f40fdc08bd65b89bfabec6575320d5c2ce31107d3f24"} Jun 13 01:00:14.786291 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.786161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-647b4987fd-8bpv2" event={"ID":"5a5ca467-4268-4c15-b554-8655e2cd58cb","Type":"ContainerStarted","Data":"6f274061f664824af281bb80a5a04262c0ad3ed9da2eb3ab851e2d37fb4fb56e"} Jun 13 01:00:14.799339 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.799287 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rw8dv" podStartSLOduration=251.079219979 podStartE2EDuration="4m12.799273224s" totalImagesPullingTime="1.720053245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:14.798186343 +0000 UTC m=+288.309602176" watchObservedRunningTime="2026-06-13 01:00:14.799273224 +0000 UTC m=+288.310689034" Jun 13 01:00:14.812768 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.812725 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:14.814263 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.814214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-647b4987fd-8bpv2" podStartSLOduration=17.814199843 podStartE2EDuration="17.814199843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:14.813274725 +0000 UTC m=+288.324690537" watchObservedRunningTime="2026-06-13 01:00:14.814199843 +0000 UTC m=+288.325615648" Jun 13 01:00:14.815928 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.815905 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:14.971491 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:14.971403 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.790684 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:15.790637 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:15.791898 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:15.791760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.792035 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:15.791954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-647b4987fd-8bpv2" Jun 13 01:00:15.975838 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:15.975793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:16.171095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.170992 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:16.377077 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.377040 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:16.795690 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.795599 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" event={"ID":"c80afca8-5283-4ac6-b156-2834c4078dc4","Type":"ContainerStarted","Data":"d60aa578f427b548a3d261bc91dd696d85500b8edb2c5a674575a2af132a17a0"} Jun 13 01:00:16.796210 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.795701 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" event={"ID":"c80afca8-5283-4ac6-b156-2834c4078dc4","Type":"ContainerStarted","Data":"bb9fec3ece43f783b268ff01a6658f270fb2ac9953d47be3f8854ac7cd08327c"} Jun 13 01:00:16.811476 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.811429 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-772c2" podStartSLOduration=18.170324266 podStartE2EDuration="19.811414371s" totalImagesPullingTime="1.641090105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:16.810782216 +0000 UTC m=+290.322198025" watchObservedRunningTime="2026-06-13 01:00:16.811414371 +0000 UTC m=+290.322830179" Jun 13 01:00:16.927427 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:16.927397 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:17.207378 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:17.207298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:17.381906 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:17.381874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:17.593209 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:17.593154 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:17.977294 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:17.977210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:18.337348 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:18.337314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:18.883125 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:18.883087 2558 scope.go:117] "RemoveContainer" containerID="44815160f44ef4f778e741e65605bde9ef44c0878f76ca169fb1781257e6cc7e" Jun 13 01:00:19.526199 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.526137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:19.626886 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.626852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:19.678398 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.678359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:19.729663 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.729627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:19.729830 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.729711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:19.730165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.730141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c60aa0b8-83f3-46df-97b7-4a53293131a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:19.731908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.731888 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c60aa0b8-83f3-46df-97b7-4a53293131a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkrz6\" (UID: \"c60aa0b8-83f3-46df-97b7-4a53293131a3\") " pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:19.795988 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.795960 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vkrz6" Jun 13 01:00:19.807246 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.807222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:00:19.807351 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.807295 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" event={"ID":"fc9b2b19-72ce-4da3-96ba-90853666be05","Type":"ContainerStarted","Data":"2ead78918d9ab67e6d241a263a93199c47606450c53219d70bc07ac252178808"} Jun 13 01:00:19.807663 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.807640 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 01:00:19.813021 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.812995 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" Jun 13 01:00:19.819827 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.819804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:19.824242 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.824197 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-zl5rr" podStartSLOduration=19.168204769 podStartE2EDuration="22.824183649s" totalImagesPullingTime="3.65597888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:19.822768502 +0000 UTC m=+293.334184292" watchObservedRunningTime="2026-06-13 01:00:19.824183649 +0000 UTC m=+293.335599449" Jun 13 01:00:19.922641 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:19.922600 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vkrz6"] Jun 13 01:00:19.925539 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:19.925512 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60aa0b8_83f3_46df_97b7_4a53293131a3.slice/crio-2a40d1cc9a60e301ba0bebe93bd091c759d46676c5a0a537b956ffacb0f4d074 WatchSource:0}: Error finding container 2a40d1cc9a60e301ba0bebe93bd091c759d46676c5a0a537b956ffacb0f4d074: Status 404 returned error can't find the container with id 2a40d1cc9a60e301ba0bebe93bd091c759d46676c5a0a537b956ffacb0f4d074 Jun 13 01:00:20.204145 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:20.204064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:20.258547 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:20.258491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:20.606367 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:20.606335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:20.662843 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:20.662681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:20.812604 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:20.812499 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkrz6" event={"ID":"c60aa0b8-83f3-46df-97b7-4a53293131a3","Type":"ContainerStarted","Data":"2a40d1cc9a60e301ba0bebe93bd091c759d46676c5a0a537b956ffacb0f4d074"} Jun 13 01:00:21.010948 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:21.010865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:21.064467 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:21.064435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:21.409511 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:21.409451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:21.510841 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:21.510792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:21.887666 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:21.887627 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mrtvs" podUID="aac28d23-ca23-4c9b-ae46-c91e02fb5d27" Jun 13 01:00:23.425727 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:23.425681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:23.628351 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:23.628269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:23.729077 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:23.729042 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:23.826204 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:23.826150 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkrz6" event={"ID":"c60aa0b8-83f3-46df-97b7-4a53293131a3","Type":"ContainerStarted","Data":"458677c199adefde7629ae377c5c90fcc5f3420efb44364e0bde24fea689db2b"} Jun 13 01:00:24.793215 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:24.793160 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rw8dv" Jun 13 01:00:24.836678 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:24.836633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkrz6" event={"ID":"c60aa0b8-83f3-46df-97b7-4a53293131a3","Type":"ContainerStarted","Data":"c8d1ed388110b3839649d87ebd62415d58abb6b66802d4d925f580e79aff13d7"} Jun 13 01:00:25.842092 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:25.842054 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkrz6" event={"ID":"c60aa0b8-83f3-46df-97b7-4a53293131a3","Type":"ContainerStarted","Data":"4d879bec6c99a27bf7f0de71dd1aeb7b1747ec5e990489149629fa285c8359bd"} Jun 13 01:00:25.858528 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:25.858480 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vkrz6" podStartSLOduration=17.389782066 podStartE2EDuration="22.858466022s" totalImagesPullingTime="5.468683956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:00:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:25.856763479 +0000 UTC m=+299.368179290" watchObservedRunningTime="2026-06-13 01:00:25.858466022 +0000 UTC m=+299.369881830" Jun 13 01:00:26.839453 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:26.839425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:00:26.839625 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:26.839471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:00:26.845127 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:26.845102 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:00:26.845127 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:26.845113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:00:26.850595 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:26.850575 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:00:28.780007 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:28.779975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:29.820602 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:29.820567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:29.823266 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:29.823234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3594a1fd-797f-4f32-acc1-c3535334a444-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-m5g5w\" (UID: \"3594a1fd-797f-4f32-acc1-c3535334a444\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:30.003013 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.002980 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qxkhh\"" Jun 13 01:00:30.011811 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.011791 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" Jun 13 01:00:30.077518 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.077437 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:30.160925 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.160893 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-m5g5w"] Jun 13 01:00:30.164477 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:30.164451 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3594a1fd_797f_4f32_acc1_c3535334a444.slice/crio-ce18eea38405aac686d8fff5d2b2e7a147c94ff85f34fc517243ab60a81cbb60 WatchSource:0}: Error finding container ce18eea38405aac686d8fff5d2b2e7a147c94ff85f34fc517243ab60a81cbb60: Status 404 returned error can't find the container with id ce18eea38405aac686d8fff5d2b2e7a147c94ff85f34fc517243ab60a81cbb60 Jun 13 01:00:30.166443 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.166425 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:00:30.858154 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:30.858117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" event={"ID":"3594a1fd-797f-4f32-acc1-c3535334a444","Type":"ContainerStarted","Data":"ce18eea38405aac686d8fff5d2b2e7a147c94ff85f34fc517243ab60a81cbb60"} Jun 13 01:00:31.862568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:31.862524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" event={"ID":"3594a1fd-797f-4f32-acc1-c3535334a444","Type":"ContainerStarted","Data":"b5f6cf0f88edb98dcd170e62cb2416daa72edcf1c1527fe244111523dc14bd58"} Jun 13 01:00:31.877047 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:31.877003 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-m5g5w" podStartSLOduration=33.535815169 podStartE2EDuration="34.876987162s" totalImagesPullingTime="1.341171993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:31.876587209 +0000 UTC m=+305.388003037" watchObservedRunningTime="2026-06-13 01:00:31.876987162 +0000 UTC m=+305.388403020" Jun 13 01:00:31.978517 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:31.978472 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.039853 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.039814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.150120 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.150033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.247969 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.247937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.318202 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.318150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.324222 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.324187 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd"] Jun 13 01:00:32.327483 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.327468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:32.329294 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.329262 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 01:00:32.329420 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.329293 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hlhs8\"" Jun 13 01:00:32.336009 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.335977 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd"] Jun 13 01:00:32.439853 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.439727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-5l2vd\" (UID: \"5112c9d6-d2f7-4179-b7ca-d762474e75b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:32.540619 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.540582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-5l2vd\" (UID: \"5112c9d6-d2f7-4179-b7ca-d762474e75b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:32.540787 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:32.540757 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 13 01:00:32.540852 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:32.540833 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates podName:5112c9d6-d2f7-4179-b7ca-d762474e75b3 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:33.040810948 +0000 UTC m=+306.552226751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-5l2vd" (UID: "5112c9d6-d2f7-4179-b7ca-d762474e75b3") : secret "prometheus-operator-admission-webhook-tls" not found Jun 13 01:00:32.656844 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.656787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.670597 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.670568 2558 patch_prober.go:28] interesting pod/image-registry-656bc68cd7-hdph8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:00:32.670790 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.670621 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:00:32.718759 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.718666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:32.847707 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:32.847671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:33.044411 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:33.044377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-5l2vd\" (UID: \"5112c9d6-d2f7-4179-b7ca-d762474e75b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:33.046917 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:33.046893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5112c9d6-d2f7-4179-b7ca-d762474e75b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-5l2vd\" (UID: \"5112c9d6-d2f7-4179-b7ca-d762474e75b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:33.238882 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:33.238837 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:33.374519 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:33.374443 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd"] Jun 13 01:00:33.377137 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:33.377107 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5112c9d6_d2f7_4179_b7ca_d762474e75b3.slice/crio-b10b73ff38d2d5459be5682718554f6c3de25856544b77a8a99da3ec36f9e3f2 WatchSource:0}: Error finding container b10b73ff38d2d5459be5682718554f6c3de25856544b77a8a99da3ec36f9e3f2: Status 404 returned error can't find the container with id b10b73ff38d2d5459be5682718554f6c3de25856544b77a8a99da3ec36f9e3f2 Jun 13 01:00:33.871670 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:33.871635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" event={"ID":"5112c9d6-d2f7-4179-b7ca-d762474e75b3","Type":"ContainerStarted","Data":"b10b73ff38d2d5459be5682718554f6c3de25856544b77a8a99da3ec36f9e3f2"} Jun 13 01:00:34.754729 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.754677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:34.790726 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.790690 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:00:34.879161 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.879126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" event={"ID":"5112c9d6-d2f7-4179-b7ca-d762474e75b3","Type":"ContainerStarted","Data":"db01ea4824b523d37c9dc8c8ac5be443171db0098496433b3dcb6d153be8aef5"} Jun 13 01:00:34.879356 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.879334 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:34.887147 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.887124 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" Jun 13 01:00:34.893218 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:34.893158 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-5l2vd" podStartSLOduration=2.03740452 podStartE2EDuration="2.893142699s" totalImagesPullingTime="855.738179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:34.892242609 +0000 UTC m=+308.403658418" watchObservedRunningTime="2026-06-13 01:00:34.893142699 +0000 UTC m=+308.404558564" Jun 13 01:00:35.093497 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.093461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:35.152555 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.152522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:35.350843 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.350762 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:35.391464 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.391434 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76"] Jun 13 01:00:35.450501 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.450470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:35.478950 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.478926 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76"] Jun 13 01:00:35.479038 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.479021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.481352 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 01:00:35.481352 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481330 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 13 01:00:35.481554 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481382 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 13 01:00:35.481554 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 01:00:35.481786 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 01:00:35.481904 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.481890 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fg46j\"" Jun 13 01:00:35.513129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.513104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:35.567342 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.567296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ea694f-f38b-431d-9801-73798e4f72db-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.567342 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.567342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fngdx\" (UniqueName: \"kubernetes.io/projected/f9ea694f-f38b-431d-9801-73798e4f72db-kube-api-access-fngdx\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.567594 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.567425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.567594 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.567474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.668786 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.668693 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ea694f-f38b-431d-9801-73798e4f72db-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.668786 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.668737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fngdx\" (UniqueName: \"kubernetes.io/projected/f9ea694f-f38b-431d-9801-73798e4f72db-kube-api-access-fngdx\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.669013 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.668887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.669013 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.668924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.669418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.669385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ea694f-f38b-431d-9801-73798e4f72db-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.671331 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.671311 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.671432 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.671413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ea694f-f38b-431d-9801-73798e4f72db-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.678277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.678259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fngdx\" (UniqueName: \"kubernetes.io/projected/f9ea694f-f38b-431d-9801-73798e4f72db-kube-api-access-fngdx\") pod \"prometheus-operator-864fcfc6f9-qcv76\" (UID: \"f9ea694f-f38b-431d-9801-73798e4f72db\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.788481 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.788449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" Jun 13 01:00:35.964042 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:35.963956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76"] Jun 13 01:00:35.966779 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:35.966746 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ea694f_f38b_431d_9801_73798e4f72db.slice/crio-93af7df18ad6b5fab36bc47f5f64b8ee43aa98db42c2ed9a18c877da445abd44 WatchSource:0}: Error finding container 93af7df18ad6b5fab36bc47f5f64b8ee43aa98db42c2ed9a18c877da445abd44: Status 404 returned error can't find the container with id 93af7df18ad6b5fab36bc47f5f64b8ee43aa98db42c2ed9a18c877da445abd44 Jun 13 01:00:36.885256 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:36.885221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 01:00:36.890842 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:36.890811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" event={"ID":"f9ea694f-f38b-431d-9801-73798e4f72db","Type":"ContainerStarted","Data":"93af7df18ad6b5fab36bc47f5f64b8ee43aa98db42c2ed9a18c877da445abd44"} Jun 13 01:00:37.837895 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:37.837811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:37.896871 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:37.896834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" event={"ID":"f9ea694f-f38b-431d-9801-73798e4f72db","Type":"ContainerStarted","Data":"41f9a7fa68de0e0bba38194606d14dd2cdb15003679cdaeac0c4fc7a6c174686"} Jun 13 01:00:37.897253 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:37.896915 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" event={"ID":"f9ea694f-f38b-431d-9801-73798e4f72db","Type":"ContainerStarted","Data":"0adf2d213fcf402770d7707db24a440f5f6677fba1c712f75d220e6a430c0a49"} Jun 13 01:00:37.912796 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:37.912748 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-qcv76" podStartSLOduration=1.334113708 podStartE2EDuration="2.912732282s" totalImagesPullingTime="1.578618574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:37.911925506 +0000 UTC m=+311.423341319" watchObservedRunningTime="2026-06-13 01:00:37.912732282 +0000 UTC m=+311.424148108" Jun 13 01:00:37.919930 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:37.919906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:39.486722 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.486671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:39.630276 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.630246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:39.734433 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.734401 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:39.828876 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.828813 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8"] Jun 13 01:00:39.839710 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.839691 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:39.844003 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.843982 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 13 01:00:39.844165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.844146 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 13 01:00:39.844263 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.844221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 13 01:00:39.857253 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.857234 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-955st\"" Jun 13 01:00:39.859306 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.859283 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8"] Jun 13 01:00:39.899935 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.899909 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-srlz7"] Jun 13 01:00:39.908496 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.908468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:39.909604 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.909588 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:39.911696 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.911670 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qbq6\"" Jun 13 01:00:39.911842 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.911822 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 01:00:39.912224 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.912206 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 01:00:39.912436 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.912421 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 01:00:39.993992 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:39.993964 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.008070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-tls\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp49b\" (UniqueName: \"kubernetes.io/projected/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-api-access-zp49b\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e312af95-5df1-40aa-99f2-d2cb3a3ed787-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008270 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vkh\" (UniqueName: \"kubernetes.io/projected/1773c825-d520-4478-92e4-32ee3ff1445a-kube-api-access-d8vkh\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008270 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-wtmp\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008270 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008270 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008388 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-sys\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008388 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-textfile\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008442 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-root\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008442 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-accelerators-collector-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.008442 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.008525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.008516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-metrics-client-ca\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.092211 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.092094 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.109273 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vkh\" (UniqueName: \"kubernetes.io/projected/1773c825-d520-4478-92e4-32ee3ff1445a-kube-api-access-d8vkh\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109349 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-wtmp\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109349 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.109459 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-wtmp\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109518 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.109622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-sys\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-textfile\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-root\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-accelerators-collector-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-sys\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.109874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109669 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1773c825-d520-4478-92e4-32ee3ff1445a-root\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.109874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.109874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-metrics-client-ca\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-tls\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-textfile\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp49b\" (UniqueName: \"kubernetes.io/projected/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-api-access-zp49b\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e312af95-5df1-40aa-99f2-d2cb3a3ed787-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.109991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.110071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.110002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110399 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.110244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-accelerators-collector-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110399 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.110335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.110474 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.110410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1773c825-d520-4478-92e4-32ee3ff1445a-metrics-client-ca\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.110585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.110556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e312af95-5df1-40aa-99f2-d2cb3a3ed787-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.112308 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.112288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-tls\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.112414 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.112347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.112414 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.112348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1773c825-d520-4478-92e4-32ee3ff1445a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.112490 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.112472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.118850 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.118831 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp49b\" (UniqueName: \"kubernetes.io/projected/e312af95-5df1-40aa-99f2-d2cb3a3ed787-kube-api-access-zp49b\") pod \"kube-state-metrics-678bc549d7-pl9p8\" (UID: \"e312af95-5df1-40aa-99f2-d2cb3a3ed787\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.119139 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.118987 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vkh\" (UniqueName: \"kubernetes.io/projected/1773c825-d520-4478-92e4-32ee3ff1445a-kube-api-access-d8vkh\") pod \"node-exporter-srlz7\" (UID: \"1773c825-d520-4478-92e4-32ee3ff1445a\") " pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.149482 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.149463 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" Jun 13 01:00:40.219300 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.219268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srlz7" Jun 13 01:00:40.255745 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:40.255707 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1773c825_d520_4478_92e4_32ee3ff1445a.slice/crio-7f063fb3e1f7cd4b6180c3ed4a60ff54623a2bc407a3ee2782f9da29607fa281 WatchSource:0}: Error finding container 7f063fb3e1f7cd4b6180c3ed4a60ff54623a2bc407a3ee2782f9da29607fa281: Status 404 returned error can't find the container with id 7f063fb3e1f7cd4b6180c3ed4a60ff54623a2bc407a3ee2782f9da29607fa281 Jun 13 01:00:40.295107 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.295074 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.323165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.323141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8"] Jun 13 01:00:40.325556 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:40.325532 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode312af95_5df1_40aa_99f2_d2cb3a3ed787.slice/crio-4228e9cc01489248e844c885610ad7a7d40d4e6144833a61da86e2b7d573c821 WatchSource:0}: Error finding container 4228e9cc01489248e844c885610ad7a7d40d4e6144833a61da86e2b7d573c821: Status 404 returned error can't find the container with id 4228e9cc01489248e844c885610ad7a7d40d4e6144833a61da86e2b7d573c821 Jun 13 01:00:40.489203 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.489086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.673973 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.673903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.758817 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.758720 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.881640 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.881575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:40.913993 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.913628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srlz7" event={"ID":"1773c825-d520-4478-92e4-32ee3ff1445a","Type":"ContainerStarted","Data":"7f063fb3e1f7cd4b6180c3ed4a60ff54623a2bc407a3ee2782f9da29607fa281"} Jun 13 01:00:40.916017 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:40.915979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" event={"ID":"e312af95-5df1-40aa-99f2-d2cb3a3ed787","Type":"ContainerStarted","Data":"4228e9cc01489248e844c885610ad7a7d40d4e6144833a61da86e2b7d573c821"} Jun 13 01:00:42.635620 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.635584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:42.725925 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.725888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:42.803731 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.803699 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:42.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.925474 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" event={"ID":"e312af95-5df1-40aa-99f2-d2cb3a3ed787","Type":"ContainerStarted","Data":"a8714b64a86041c38e416822051f47a95cec65697423928ebf32fd23c2fe3478"} Jun 13 01:00:42.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.925538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" event={"ID":"e312af95-5df1-40aa-99f2-d2cb3a3ed787","Type":"ContainerStarted","Data":"b28a387ce0eefa156ae8b794b2d12f693c7f6e9f843306560e9095d6051a8e92"} Jun 13 01:00:42.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.925567 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" event={"ID":"e312af95-5df1-40aa-99f2-d2cb3a3ed787","Type":"ContainerStarted","Data":"16ec6e8ce345de975478c60c740e9e1add22f11d409e690d4bb90c0ac51cfa0d"} Jun 13 01:00:42.927083 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.927051 2558 generic.go:356] "Generic (PLEG): container finished" podID="1773c825-d520-4478-92e4-32ee3ff1445a" containerID="334028038aab32fb68702cf69fe7b48e6cc1f3a13a4aa1480c48ec3078dac477" exitCode=0 Jun 13 01:00:42.927213 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.927128 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srlz7" event={"ID":"1773c825-d520-4478-92e4-32ee3ff1445a","Type":"ContainerDied","Data":"334028038aab32fb68702cf69fe7b48e6cc1f3a13a4aa1480c48ec3078dac477"} Jun 13 01:00:42.945749 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:42.945700 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pl9p8" podStartSLOduration=2.241101137 podStartE2EDuration="3.94568044s" totalImagesPullingTime="1.704579303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:42.944504283 +0000 UTC m=+316.455920100" watchObservedRunningTime="2026-06-13 01:00:42.94568044 +0000 UTC m=+316.457096251" Jun 13 01:00:43.043417 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:43.043393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:43.932492 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:43.932446 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srlz7" event={"ID":"1773c825-d520-4478-92e4-32ee3ff1445a","Type":"ContainerStarted","Data":"81d7b9dbf572045e11b499cd17d59218317b530d8877ff25456deecf9e809281"} Jun 13 01:00:43.932902 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:43.932513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srlz7" event={"ID":"1773c825-d520-4478-92e4-32ee3ff1445a","Type":"ContainerStarted","Data":"ae96e0257e04d4954d224a6e59ad34b8875ee13ac962c80df5b3d632f8a1edf4"} Jun 13 01:00:43.952886 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:43.952830 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-srlz7" podStartSLOduration=3.058659779 podStartE2EDuration="4.95280849s" totalImagesPullingTime="1.768915926s" totalInitContainerRuntime="125.232785ms" isStatefulPod=true podCreationTimestamp="2026-06-13 01:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:43.951214997 +0000 UTC m=+317.462630806" watchObservedRunningTime="2026-06-13 01:00:43.95280849 +0000 UTC m=+317.464224331" Jun 13 01:00:44.509369 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.509333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:44.525572 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.525544 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b"] Jun 13 01:00:44.528844 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.528815 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.530976 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.530952 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 13 01:00:44.531147 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.531125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z92kn\"" Jun 13 01:00:44.538309 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.537841 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b"] Jun 13 01:00:44.548486 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.548462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vh89\" (UniqueName: \"kubernetes.io/projected/bd6620ef-b543-44f5-8d79-22b5cd67e798-kube-api-access-6vh89\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.548605 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.548563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.608797 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.608760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:44.648906 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.648878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.649039 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.648921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vh89\" (UniqueName: \"kubernetes.io/projected/bd6620ef-b543-44f5-8d79-22b5cd67e798-kube-api-access-6vh89\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.649039 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:44.649031 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 13 01:00:44.649145 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:00:44.649099 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert podName:bd6620ef-b543-44f5-8d79-22b5cd67e798 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:45.149078363 +0000 UTC m=+318.660494155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-v2w7b" (UID: "bd6620ef-b543-44f5-8d79-22b5cd67e798") : secret "monitoring-plugin-cert" not found Jun 13 01:00:44.657074 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.657046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vh89\" (UniqueName: \"kubernetes.io/projected/bd6620ef-b543-44f5-8d79-22b5cd67e798-kube-api-access-6vh89\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:44.969371 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:44.969341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:45.126943 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.126914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:45.152873 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.152830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:45.158320 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.156444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd6620ef-b543-44f5-8d79-22b5cd67e798-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v2w7b\" (UID: \"bd6620ef-b543-44f5-8d79-22b5cd67e798\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:45.225893 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.225789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:45.440586 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.440550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:45.568925 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.568773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b"] Jun 13 01:00:45.571423 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:45.571394 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6620ef_b543_44f5_8d79_22b5cd67e798.slice/crio-90acf9bdd6308e7e7f06fc19266aff9d6358569da32e7c7d23662236f14b31a9 WatchSource:0}: Error finding container 90acf9bdd6308e7e7f06fc19266aff9d6358569da32e7c7d23662236f14b31a9: Status 404 returned error can't find the container with id 90acf9bdd6308e7e7f06fc19266aff9d6358569da32e7c7d23662236f14b31a9 Jun 13 01:00:45.942338 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.942259 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" event={"ID":"bd6620ef-b543-44f5-8d79-22b5cd67e798","Type":"ContainerStarted","Data":"90acf9bdd6308e7e7f06fc19266aff9d6358569da32e7c7d23662236f14b31a9"} Jun 13 01:00:45.953403 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:45.953370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:46.706754 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.706693 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:46.763938 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.763903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:46.947071 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.947037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" event={"ID":"bd6620ef-b543-44f5-8d79-22b5cd67e798","Type":"ContainerStarted","Data":"6b1d66fb1afe8f768d7986d000170a36d728e31de9c6cbf7a6d8ecc78b8a680e"} Jun 13 01:00:46.947280 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.947191 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:46.952159 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.952137 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" Jun 13 01:00:46.961700 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:46.961616 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v2w7b" podStartSLOduration=1.7939471070000002 podStartE2EDuration="2.961601564s" totalImagesPullingTime="1.167654457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:46.960575225 +0000 UTC m=+320.471991034" watchObservedRunningTime="2026-06-13 01:00:46.961601564 +0000 UTC m=+320.473017373" Jun 13 01:00:48.708590 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:48.708555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:48.809613 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:48.809564 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:49.633337 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:49.633299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:49.733910 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:49.733874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:50.234336 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.234297 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:00:50.237901 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.237878 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.240122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240073 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 01:00:50.240122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240078 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 01:00:50.240899 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240873 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 01:00:50.240899 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240876 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pj6bb\"" Jun 13 01:00:50.241070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240945 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 01:00:50.241070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240976 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 01:00:50.241070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.240872 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 01:00:50.241225 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.241126 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 01:00:50.244721 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.244696 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 01:00:50.245927 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.245906 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:00:50.290619 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8bx\" (UniqueName: \"kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.290955 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.290818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391114 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391494 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391320 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391494 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391494 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8bx\" (UniqueName: \"kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.391996 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.391974 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.392108 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.392059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.392153 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.392105 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.392213 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.392152 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.394109 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.394086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.394226 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.394186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.399559 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.399539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8bx\" (UniqueName: \"kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx\") pod \"console-7f85889c66-nw8tc\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.547766 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.547728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:00:50.674899 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.674873 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:00:50.677662 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:00:50.677633 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2a1f7d_4cac_4956_8a0e_cec9e1755908.slice/crio-7676b7d3446e757d2e1c30428ce1f250fee5ce34ddb1ee31492e59dc3809d272 WatchSource:0}: Error finding container 7676b7d3446e757d2e1c30428ce1f250fee5ce34ddb1ee31492e59dc3809d272: Status 404 returned error can't find the container with id 7676b7d3446e757d2e1c30428ce1f250fee5ce34ddb1ee31492e59dc3809d272 Jun 13 01:00:50.703021 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.702992 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 01:00:50.782479 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.782449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:50.839768 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.839686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:50.963816 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.963787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f85889c66-nw8tc" event={"ID":"4c2a1f7d-4cac-4956-8a0e-cec9e1755908","Type":"ContainerStarted","Data":"7676b7d3446e757d2e1c30428ce1f250fee5ce34ddb1ee31492e59dc3809d272"} Jun 13 01:00:50.986194 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:50.986145 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:51.044571 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:51.044521 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:53.635970 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:53.635885 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:53.701261 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:53.701231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:53.981258 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:53.980918 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f85889c66-nw8tc" event={"ID":"4c2a1f7d-4cac-4956-8a0e-cec9e1755908","Type":"ContainerStarted","Data":"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8"} Jun 13 01:00:53.996971 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:53.996915 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f85889c66-nw8tc" podStartSLOduration=0.944029029 podStartE2EDuration="3.996899186s" totalImagesPullingTime="3.052870157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:53.996214263 +0000 UTC m=+327.507630097" watchObservedRunningTime="2026-06-13 01:00:53.996899186 +0000 UTC m=+327.508314994" Jun 13 01:00:55.639017 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:55.638976 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:55.739948 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:55.739913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:56.999911 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:56.999878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:57.104430 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:57.104393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:57.172444 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:00:57.172410 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:00.548367 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:00.548332 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:01:00.548820 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:00.548401 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:01:00.553107 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:00.553083 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:01:01.013920 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:01.013622 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:01:02.441310 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:02.441275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:03.040597 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:03.040564 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:08.617503 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:08.617470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:08.668528 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:08.668476 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:09.048309 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:09.048276 2558 generic.go:356] "Generic (PLEG): container finished" podID="47c5a238-e76a-4415-a56e-551031ad3420" containerID="dedb0860156bbc0059c1f7df969574b06929333a78b5bc9d5fe72fd2b88ade19" exitCode=0 Jun 13 01:01:09.048478 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:09.048349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" event={"ID":"47c5a238-e76a-4415-a56e-551031ad3420","Type":"ContainerDied","Data":"dedb0860156bbc0059c1f7df969574b06929333a78b5bc9d5fe72fd2b88ade19"} Jun 13 01:01:09.048672 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:09.048658 2558 scope.go:117] "RemoveContainer" containerID="dedb0860156bbc0059c1f7df969574b06929333a78b5bc9d5fe72fd2b88ade19" Jun 13 01:01:10.054379 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:10.054343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-jp48b" event={"ID":"47c5a238-e76a-4415-a56e-551031ad3420","Type":"ContainerStarted","Data":"39a4d05acb93eaae2a4e1f5ecdaf191f5b3bb1b7fbbf41a17fe4112f33a44ba7"} Jun 13 01:01:15.728261 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:15.728227 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerName="registry" containerID="cri-o://79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3" gracePeriod=30 Jun 13 01:01:15.977015 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:15.976989 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:01:16.078418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.078387 2558 generic.go:356] "Generic (PLEG): container finished" podID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerID="79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3" exitCode=0 Jun 13 01:01:16.078609 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.078429 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" Jun 13 01:01:16.078609 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.078472 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" event={"ID":"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846","Type":"ContainerDied","Data":"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3"} Jun 13 01:01:16.078609 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.078529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656bc68cd7-hdph8" event={"ID":"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846","Type":"ContainerDied","Data":"e7d618a8555c07c22252f262a520572e3025f057ca07a05be6417141ed0218d2"} Jun 13 01:01:16.078609 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.078556 2558 scope.go:117] "RemoveContainer" containerID="79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3" Jun 13 01:01:16.086967 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.086952 2558 scope.go:117] "RemoveContainer" containerID="79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3" Jun 13 01:01:16.087249 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:01:16.087227 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3\": container with ID starting with 79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3 not found: ID does not exist" containerID="79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3" Jun 13 01:01:16.087321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.087262 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3"} err="failed to get container status \"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3\": rpc error: code = NotFound desc = could not find container \"79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3\": container with ID starting with 79b1630fd35392fdc04523a0c5bb00bb90696bf31a49be13954a16ee8db007c3 not found: ID does not exist" Jun 13 01:01:16.107025 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107004 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107037 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107062 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107121 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7gts\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107140 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107401 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107178 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107401 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107206 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107401 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107236 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates\") pod \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\" (UID: \"4d0fd0f5-4b63-4d8a-96c3-ce05d9616846\") " Jun 13 01:01:16.107543 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107452 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:01:16.107598 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107565 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-trusted-ca\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.107960 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.107915 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:01:16.109705 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.109649 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:01:16.109830 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.109789 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:01:16.109893 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.109836 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts" (OuterVolumeSpecName: "kube-api-access-l7gts") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "kube-api-access-l7gts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:01:16.110047 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.110022 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:01:16.110159 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.110118 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:01:16.116155 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.116130 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" (UID: "4d0fd0f5-4b63-4d8a-96c3-ce05d9616846"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:01:16.208301 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208246 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7gts\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-kube-api-access-l7gts\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208301 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208296 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-tls\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208301 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208307 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-image-registry-private-configuration\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208301 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208317 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-ca-trust-extracted\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208576 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208326 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-registry-certificates\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208576 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208335 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-installation-pull-secrets\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.208576 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.208343 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846-bound-sa-token\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:01:16.401266 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.401236 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 01:01:16.406549 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.406526 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-656bc68cd7-hdph8"] Jun 13 01:01:16.887989 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:16.887959 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" path="/var/lib/kubelet/pods/4d0fd0f5-4b63-4d8a-96c3-ce05d9616846/volumes" Jun 13 01:01:33.149850 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.149812 2558 generic.go:356] "Generic (PLEG): container finished" podID="2d315867-6864-4f4b-8f02-09e0f7835846" containerID="76394beeb162e5652e5282996d46b952b1ec5fb38f4e714568a77880dd26fb39" exitCode=0 Jun 13 01:01:33.150305 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.149885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" event={"ID":"2d315867-6864-4f4b-8f02-09e0f7835846","Type":"ContainerDied","Data":"76394beeb162e5652e5282996d46b952b1ec5fb38f4e714568a77880dd26fb39"} Jun 13 01:01:33.150370 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.150311 2558 scope.go:117] "RemoveContainer" containerID="76394beeb162e5652e5282996d46b952b1ec5fb38f4e714568a77880dd26fb39" Jun 13 01:01:33.151706 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.151610 2558 generic.go:356] "Generic (PLEG): container finished" podID="5b370a52-643d-472d-ba46-a8d5f74e398c" containerID="f71e83dd2f81deaadea17a89ac9735c0e8707ab52ba985661e9ed9416fb1c4d8" exitCode=0 Jun 13 01:01:33.151706 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.151668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" event={"ID":"5b370a52-643d-472d-ba46-a8d5f74e398c","Type":"ContainerDied","Data":"f71e83dd2f81deaadea17a89ac9735c0e8707ab52ba985661e9ed9416fb1c4d8"} Jun 13 01:01:33.151987 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:33.151961 2558 scope.go:117] "RemoveContainer" containerID="f71e83dd2f81deaadea17a89ac9735c0e8707ab52ba985661e9ed9416fb1c4d8" Jun 13 01:01:34.157901 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:34.157864 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p7w9k" event={"ID":"5b370a52-643d-472d-ba46-a8d5f74e398c","Type":"ContainerStarted","Data":"4e09e30869a7dcab462dc7e09ad559d1b449b6f5ff76c211c74e27a8fe4e084e"} Jun 13 01:01:34.159685 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:34.159652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-rmmgf" event={"ID":"2d315867-6864-4f4b-8f02-09e0f7835846","Type":"ContainerStarted","Data":"4453a900985ba9283467a195f4e3c17c0318e1275774a509a1120a408bd90fd3"} Jun 13 01:01:40.714742 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:40.714686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 01:01:40.717063 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:40.717039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aac28d23-ca23-4c9b-ae46-c91e02fb5d27-metrics-certs\") pod \"network-metrics-daemon-mrtvs\" (UID: \"aac28d23-ca23-4c9b-ae46-c91e02fb5d27\") " pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 01:01:40.787430 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:40.787399 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v7h5\"" Jun 13 01:01:40.796744 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:40.796724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrtvs" Jun 13 01:01:40.923520 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:40.923496 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrtvs"] Jun 13 01:01:40.925886 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:01:40.925863 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac28d23_ca23_4c9b_ae46_c91e02fb5d27.slice/crio-3f5a08645a54efcefea133d70c4c7bbe15b9dbc5ff1558b1284fc01401b69f80 WatchSource:0}: Error finding container 3f5a08645a54efcefea133d70c4c7bbe15b9dbc5ff1558b1284fc01401b69f80: Status 404 returned error can't find the container with id 3f5a08645a54efcefea133d70c4c7bbe15b9dbc5ff1558b1284fc01401b69f80 Jun 13 01:01:41.189308 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:41.189278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrtvs" event={"ID":"aac28d23-ca23-4c9b-ae46-c91e02fb5d27","Type":"ContainerStarted","Data":"3f5a08645a54efcefea133d70c4c7bbe15b9dbc5ff1558b1284fc01401b69f80"} Jun 13 01:01:42.195031 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:42.194995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrtvs" event={"ID":"aac28d23-ca23-4c9b-ae46-c91e02fb5d27","Type":"ContainerStarted","Data":"9a41cff8d891c23dbea03d7649b88b7ab45accd3bf44b22ecd3681cc0dddf3b2"} Jun 13 01:01:42.195443 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:42.195060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrtvs" event={"ID":"aac28d23-ca23-4c9b-ae46-c91e02fb5d27","Type":"ContainerStarted","Data":"3ba8d2ca6b1ef624a7acbe5d472ce04aa341ec3e8fada1aa0325fca133ec9224"} Jun 13 01:01:42.210145 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:42.210025 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mrtvs" podStartSLOduration=374.174824965 podStartE2EDuration="6m15.210006784s" totalImagesPullingTime="1.035181819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:01:42.209673253 +0000 UTC m=+375.721089063" watchObservedRunningTime="2026-06-13 01:01:42.210006784 +0000 UTC m=+375.721422595" Jun 13 01:01:42.303611 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:42.303573 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:42.358479 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:42.358441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:50.057422 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:50.057382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:50.159107 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:50.159075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:58.986510 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:58.986475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:59.190202 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:01:59.190145 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:08.842627 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:08.842592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:08.947548 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:08.947513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:09.002540 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:09.002501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:09.056148 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:09.056110 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:14.243712 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:14.243679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:14.296573 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:14.296527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:19.568076 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.568040 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:02:19.568474 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.568349 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerName="registry" Jun 13 01:02:19.568474 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.568362 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerName="registry" Jun 13 01:02:19.568474 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.568429 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0fd0f5-4b63-4d8a-96c3-ce05d9616846" containerName="registry" Jun 13 01:02:19.570324 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.570307 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.581118 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.581091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:02:19.720814 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.720769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.720827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.720853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.720913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.720983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.721005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.721224 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.721027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrnk8\" (UniqueName: \"kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrnk8\" (UniqueName: \"kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824903 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824903 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824693 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824903 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.824903 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.824765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.825456 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.825427 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.825755 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.825728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.825862 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.825728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.825862 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.825782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.827521 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.827494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.827642 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.827574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.831743 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.831718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrnk8\" (UniqueName: \"kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8\") pod \"console-6c6f5f9db7-7w58d\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:19.879804 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:19.879768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:20.009277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:20.009242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:02:20.012689 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:02:20.012664 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa6d834_5b87_420f_857a_60cafbc7f337.slice/crio-67607dfa828dede80740686e09757eccdff35c0f9734020331916b5ade007cc4 WatchSource:0}: Error finding container 67607dfa828dede80740686e09757eccdff35c0f9734020331916b5ade007cc4: Status 404 returned error can't find the container with id 67607dfa828dede80740686e09757eccdff35c0f9734020331916b5ade007cc4 Jun 13 01:02:20.357844 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:20.357808 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f5f9db7-7w58d" event={"ID":"8fa6d834-5b87-420f-857a-60cafbc7f337","Type":"ContainerStarted","Data":"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d"} Jun 13 01:02:20.358017 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:20.357862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f5f9db7-7w58d" event={"ID":"8fa6d834-5b87-420f-857a-60cafbc7f337","Type":"ContainerStarted","Data":"67607dfa828dede80740686e09757eccdff35c0f9734020331916b5ade007cc4"} Jun 13 01:02:20.373828 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:20.373778 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6f5f9db7-7w58d" podStartSLOduration=1.373762355 podStartE2EDuration="1.373762355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:02:20.372641921 +0000 UTC m=+413.884057731" watchObservedRunningTime="2026-06-13 01:02:20.373762355 +0000 UTC m=+413.885178162" Jun 13 01:02:26.250805 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:26.250765 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:26.301608 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:26.301572 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:29.880575 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:29.880523 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:29.881067 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:29.880595 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:29.885940 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:29.885911 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:30.402185 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:30.402131 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:02:30.453739 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:30.453694 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:02:30.541844 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:30.541813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:30.646602 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:30.646568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:30.698398 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:30.698320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:38.638452 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:38.638417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:38.739584 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:38.739550 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:55.482404 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.482308 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f85889c66-nw8tc" podUID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" containerName="console" containerID="cri-o://50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8" gracePeriod=15 Jun 13 01:02:55.722560 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.722526 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:02:55.824062 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824062 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824069 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824096 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824219 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq8bx\" (UniqueName: \"kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824260 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824301 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824468 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824369 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca\") pod \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\" (UID: \"4c2a1f7d-4cac-4956-8a0e-cec9e1755908\") " Jun 13 01:02:55.824601 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824575 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config" (OuterVolumeSpecName: "console-config") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:02:55.824601 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824586 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:02:55.824779 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824679 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:02:55.824870 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.824851 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:02:55.826468 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.826435 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx" (OuterVolumeSpecName: "kube-api-access-rq8bx") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "kube-api-access-rq8bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:02:55.826468 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.826445 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:02:55.826468 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.826460 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c2a1f7d-4cac-4956-8a0e-cec9e1755908" (UID: "4c2a1f7d-4cac-4956-8a0e-cec9e1755908"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:02:55.925335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925301 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-service-ca\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925326 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-config\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925336 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-serving-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925346 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-trusted-ca-bundle\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925355 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq8bx\" (UniqueName: \"kubernetes.io/projected/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-kube-api-access-rq8bx\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925363 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-oauth-serving-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:55.925585 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:55.925372 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2a1f7d-4cac-4956-8a0e-cec9e1755908-console-oauth-config\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:02:56.439712 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.439662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:56.502430 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.502396 2558 generic.go:356] "Generic (PLEG): container finished" podID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" containerID="50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8" exitCode=0 Jun 13 01:02:56.502881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.502437 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f85889c66-nw8tc" Jun 13 01:02:56.502881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.502464 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f85889c66-nw8tc" event={"ID":"4c2a1f7d-4cac-4956-8a0e-cec9e1755908","Type":"ContainerDied","Data":"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8"} Jun 13 01:02:56.502881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.502514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f85889c66-nw8tc" event={"ID":"4c2a1f7d-4cac-4956-8a0e-cec9e1755908","Type":"ContainerDied","Data":"7676b7d3446e757d2e1c30428ce1f250fee5ce34ddb1ee31492e59dc3809d272"} Jun 13 01:02:56.502881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.502543 2558 scope.go:117] "RemoveContainer" containerID="50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8" Jun 13 01:02:56.511085 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.511069 2558 scope.go:117] "RemoveContainer" containerID="50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8" Jun 13 01:02:56.511350 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:02:56.511331 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8\": container with ID starting with 50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8 not found: ID does not exist" containerID="50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8" Jun 13 01:02:56.511418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.511357 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8"} err="failed to get container status \"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8\": rpc error: code = NotFound desc = could not find container \"50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8\": container with ID starting with 50a32c988f3a75d19f2c6245411ce4161f21332109ce41b6417ce5b657f54aa8 not found: ID does not exist" Jun 13 01:02:56.530784 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.530750 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:02:56.539629 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.539600 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f85889c66-nw8tc"] Jun 13 01:02:56.553873 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.553848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:56.887773 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:02:56.887745 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" path="/var/lib/kubelet/pods/4c2a1f7d-4cac-4956-8a0e-cec9e1755908/volumes" Jun 13 01:03:03.737828 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:03.737790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:14.590713 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:14.590677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:23.047964 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:23.047926 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:23.887706 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:23.887673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:26.670009 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:26.669969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:26.772542 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:26.772509 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:27.777483 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:27.777444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:27.880913 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:27.880873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:28.038123 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:28.038035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:28.126475 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:28.126401 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:31.508740 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.508709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:31.838686 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.838656 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs"] Jun 13 01:03:31.838978 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.838965 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" containerName="console" Jun 13 01:03:31.839024 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.838979 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" containerName="console" Jun 13 01:03:31.839061 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.839040 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2a1f7d-4cac-4956-8a0e-cec9e1755908" containerName="console" Jun 13 01:03:31.843324 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.843303 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:31.845420 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.845400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 01:03:31.845538 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.845461 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 01:03:31.845774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.845756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xwp5q\"" Jun 13 01:03:31.850566 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.850544 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs"] Jun 13 01:03:31.877780 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:31.877756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:32.033971 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.033928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vxjq\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-kube-api-access-2vxjq\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.033971 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.033976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.134437 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.134354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vxjq\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-kube-api-access-2vxjq\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.134437 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.134399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.142310 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.142283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.142486 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.142467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vxjq\" (UniqueName: \"kubernetes.io/projected/19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f-kube-api-access-2vxjq\") pod \"cert-manager-cainjector-5d99449ffd-dwgbs\" (UID: \"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.164618 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.164593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" Jun 13 01:03:32.295796 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.295758 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs"] Jun 13 01:03:32.299070 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:03:32.299043 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19d28c82_d9b0_4d5e_a2be_493eb0c7ec5f.slice/crio-92d548b8157aa737286b8571831f967799957e9cf3078e4505fb680271ffdae8 WatchSource:0}: Error finding container 92d548b8157aa737286b8571831f967799957e9cf3078e4505fb680271ffdae8: Status 404 returned error can't find the container with id 92d548b8157aa737286b8571831f967799957e9cf3078e4505fb680271ffdae8 Jun 13 01:03:32.659095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:32.659055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" event={"ID":"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f","Type":"ContainerStarted","Data":"92d548b8157aa737286b8571831f967799957e9cf3078e4505fb680271ffdae8"} Jun 13 01:03:33.457947 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:33.457911 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:33.525418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:33.525373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:35.675821 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:35.675785 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" event={"ID":"19d28c82-d9b0-4d5e-a2be-493eb0c7ec5f","Type":"ContainerStarted","Data":"ce4d63afed91d85aecc63c00120f8ad47d84a25ab24627ea70a016cb9f4ad864"} Jun 13 01:03:35.694745 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:35.694694 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dwgbs" podStartSLOduration=2.026025801 podStartE2EDuration="4.694674932s" totalImagesPullingTime="2.668649131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:35.694284924 +0000 UTC m=+489.205700734" watchObservedRunningTime="2026-06-13 01:03:35.694674932 +0000 UTC m=+489.206090742" Jun 13 01:03:36.868072 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:36.868040 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:36.972087 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:36.972049 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:38.887938 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.887908 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk"] Jun 13 01:03:38.891157 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.891140 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:38.893695 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.893500 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:03:38.893695 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.893565 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tjzr5\"" Jun 13 01:03:38.893957 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.893791 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 01:03:38.895216 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.895193 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk"] Jun 13 01:03:38.991884 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.991843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2q6\" (UniqueName: \"kubernetes.io/projected/b1de8339-b986-4f4a-88b7-84a6eaf89be2-kube-api-access-4k2q6\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:38.992070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:38.991910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1de8339-b986-4f4a-88b7-84a6eaf89be2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.080516 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.080487 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:39.092748 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.092723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1de8339-b986-4f4a-88b7-84a6eaf89be2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.092852 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.092778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2q6\" (UniqueName: \"kubernetes.io/projected/b1de8339-b986-4f4a-88b7-84a6eaf89be2-kube-api-access-4k2q6\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.093138 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.093119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1de8339-b986-4f4a-88b7-84a6eaf89be2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.100618 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.100596 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2q6\" (UniqueName: \"kubernetes.io/projected/b1de8339-b986-4f4a-88b7-84a6eaf89be2-kube-api-access-4k2q6\") pod \"openshift-lws-operator-fd8ccff4c-rjtxk\" (UID: \"b1de8339-b986-4f4a-88b7-84a6eaf89be2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.200664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.200582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" Jun 13 01:03:39.358505 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.358483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk"] Jun 13 01:03:39.360903 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:03:39.360874 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1de8339_b986_4f4a_88b7_84a6eaf89be2.slice/crio-8170af1d3c4200f91674ec351042222540777dff800d377e64a8dcad31124d4a WatchSource:0}: Error finding container 8170af1d3c4200f91674ec351042222540777dff800d377e64a8dcad31124d4a: Status 404 returned error can't find the container with id 8170af1d3c4200f91674ec351042222540777dff800d377e64a8dcad31124d4a Jun 13 01:03:39.693630 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:39.693594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" event={"ID":"b1de8339-b986-4f4a-88b7-84a6eaf89be2","Type":"ContainerStarted","Data":"8170af1d3c4200f91674ec351042222540777dff800d377e64a8dcad31124d4a"} Jun 13 01:03:42.709482 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:42.709448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" event={"ID":"b1de8339-b986-4f4a-88b7-84a6eaf89be2","Type":"ContainerStarted","Data":"78443439db9e54c23a7c31a72b4d703599852ad37a99077e993f8a3e3f6cac53"} Jun 13 01:03:42.724711 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:42.724664 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjtxk" podStartSLOduration=1.5682445839999999 podStartE2EDuration="4.724650488s" totalImagesPullingTime="3.156405904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:42.723164346 +0000 UTC m=+496.234580154" watchObservedRunningTime="2026-06-13 01:03:42.724650488 +0000 UTC m=+496.236066297" Jun 13 01:03:43.388734 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:43.388693 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:43.490662 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:43.490631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:45.565623 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:45.565588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:56.895652 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:56.895617 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:56.985105 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:56.985070 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:57.546649 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.546620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:57.785777 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.785731 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:57.885038 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.884926 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:57.913800 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.913765 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt"] Jun 13 01:03:57.917411 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.917391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:57.919452 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.919433 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:03:57.919548 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.919441 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:03:57.919548 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.919530 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fnsg9\"" Jun 13 01:03:57.919774 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.919759 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:03:57.919863 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.919819 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:03:57.931132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:57.931110 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt"] Jun 13 01:03:58.049550 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.049520 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.055731 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.055706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.055874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.055780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6w77\" (UniqueName: \"kubernetes.io/projected/a2ed33f7-0568-4c75-907a-77356835cc1c-kube-api-access-s6w77\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.055874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.055819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-manifests\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.055874 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.055866 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-tmp\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.055999 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.055909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.149714 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.149633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.156810 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.156782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.156941 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.156858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6w77\" (UniqueName: \"kubernetes.io/projected/a2ed33f7-0568-4c75-907a-77356835cc1c-kube-api-access-s6w77\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.156941 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.156899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-manifests\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.156941 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.156926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-tmp\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.157165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.156964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.157469 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.157445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-manifests\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.159293 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.159258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2ed33f7-0568-4c75-907a-77356835cc1c-tmp\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.159419 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.159332 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.159419 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.159404 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2ed33f7-0568-4c75-907a-77356835cc1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.164625 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.164602 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6w77\" (UniqueName: \"kubernetes.io/projected/a2ed33f7-0568-4c75-907a-77356835cc1c-kube-api-access-s6w77\") pod \"opendatahub-operator-controller-manager-68f5d9f6fb-glqzt\" (UID: \"a2ed33f7-0568-4c75-907a-77356835cc1c\") " pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.227412 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.227381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:03:58.271103 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.271064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.363313 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.363286 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt"] Jun 13 01:03:58.365791 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:03:58.365767 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ed33f7_0568_4c75_907a_77356835cc1c.slice/crio-284e9300a86b8668bc7e40d22b86701d7ac56c68da1010a7cb2c328ffcaac58a WatchSource:0}: Error finding container 284e9300a86b8668bc7e40d22b86701d7ac56c68da1010a7cb2c328ffcaac58a: Status 404 returned error can't find the container with id 284e9300a86b8668bc7e40d22b86701d7ac56c68da1010a7cb2c328ffcaac58a Jun 13 01:03:58.368627 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.368586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.435485 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.435403 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.533463 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.533434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:58.782812 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:03:58.782727 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" event={"ID":"a2ed33f7-0568-4c75-907a-77356835cc1c","Type":"ContainerStarted","Data":"284e9300a86b8668bc7e40d22b86701d7ac56c68da1010a7cb2c328ffcaac58a"} Jun 13 01:04:01.446510 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:01.446419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:01.798395 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:01.798356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" event={"ID":"a2ed33f7-0568-4c75-907a-77356835cc1c","Type":"ContainerStarted","Data":"45622cb956670890ff1fa9f65407c43ca6b7bf7ae16083c2320fa7498238e375"} Jun 13 01:04:02.804700 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:02.804670 2558 generic.go:356] "Generic (PLEG): container finished" podID="a2ed33f7-0568-4c75-907a-77356835cc1c" containerID="45622cb956670890ff1fa9f65407c43ca6b7bf7ae16083c2320fa7498238e375" exitCode=0 Jun 13 01:04:02.805123 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:02.804750 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" event={"ID":"a2ed33f7-0568-4c75-907a-77356835cc1c","Type":"ContainerDied","Data":"45622cb956670890ff1fa9f65407c43ca6b7bf7ae16083c2320fa7498238e375"} Jun 13 01:04:03.810860 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:03.810816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" event={"ID":"a2ed33f7-0568-4c75-907a-77356835cc1c","Type":"ContainerStarted","Data":"1123ce94b5c82230cb4613a583ece47457fd1b3a90a52d20476895af86dcae7d"} Jun 13 01:04:03.811231 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:03.810906 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:04:03.831165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:03.831120 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" podStartSLOduration=2.7266204 podStartE2EDuration="6.831106089s" totalImagesPullingTime="3.141943193s" totalInitContainerRuntime="962.542496ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:03.829748101 +0000 UTC m=+517.341163928" watchObservedRunningTime="2026-06-13 01:04:03.831106089 +0000 UTC m=+517.342521897" Jun 13 01:04:07.001981 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:07.001929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:07.060456 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:07.060419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:14.816598 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:14.816515 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f5d9f6fb-glqzt" Jun 13 01:04:16.430485 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:16.430454 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:16.547223 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:16.547193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.199119 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.199088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.300433 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.300402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.395790 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.395749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.726079 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.726046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.825347 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.825311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:17.850184 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.850147 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zllwk"] Jun 13 01:04:17.854670 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.854651 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:17.856730 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.856711 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 13 01:04:17.856859 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.856844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6kddn\"" Jun 13 01:04:17.864666 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.864643 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zllwk"] Jun 13 01:04:17.936765 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.936724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4087d00-aa88-42f9-8484-279dd645732c-tls-certs\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:17.936954 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.936901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9knq\" (UniqueName: \"kubernetes.io/projected/a4087d00-aa88-42f9-8484-279dd645732c-kube-api-access-c9knq\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:17.967506 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:17.967464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:18.037685 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.037655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9knq\" (UniqueName: \"kubernetes.io/projected/a4087d00-aa88-42f9-8484-279dd645732c-kube-api-access-c9knq\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:18.037867 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.037711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4087d00-aa88-42f9-8484-279dd645732c-tls-certs\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:18.040325 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.040305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4087d00-aa88-42f9-8484-279dd645732c-tls-certs\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:18.045266 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.045243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9knq\" (UniqueName: \"kubernetes.io/projected/a4087d00-aa88-42f9-8484-279dd645732c-kube-api-access-c9knq\") pod \"model-serving-api-5dd488fc48-zllwk\" (UID: \"a4087d00-aa88-42f9-8484-279dd645732c\") " pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:18.167477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.167428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:18.333320 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.333091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zllwk"] Jun 13 01:04:18.337100 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:04:18.337069 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4087d00_aa88_42f9_8484_279dd645732c.slice/crio-5266a13f875670254a7997b4b6416681c07720f304e9f57acb38dc65114c80f7 WatchSource:0}: Error finding container 5266a13f875670254a7997b4b6416681c07720f304e9f57acb38dc65114c80f7: Status 404 returned error can't find the container with id 5266a13f875670254a7997b4b6416681c07720f304e9f57acb38dc65114c80f7 Jun 13 01:04:18.881479 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:18.881443 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" event={"ID":"a4087d00-aa88-42f9-8484-279dd645732c","Type":"ContainerStarted","Data":"5266a13f875670254a7997b4b6416681c07720f304e9f57acb38dc65114c80f7"} Jun 13 01:04:20.894146 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:20.894113 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" event={"ID":"a4087d00-aa88-42f9-8484-279dd645732c","Type":"ContainerStarted","Data":"5a8b799019df37861966d23a7c0935291fc6751fed431dc804e3426b899f0226"} Jun 13 01:04:20.894556 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:20.894228 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:20.911682 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:20.911636 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" podStartSLOduration=1.49970136 podStartE2EDuration="3.911621303s" totalImagesPullingTime="2.411919943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:20.910189549 +0000 UTC m=+534.421605381" watchObservedRunningTime="2026-06-13 01:04:20.911621303 +0000 UTC m=+534.423037111" Jun 13 01:04:24.359600 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.359563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:24.496689 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.496644 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz"] Jun 13 01:04:24.499357 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.499335 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.501896 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.501871 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 01:04:24.502037 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.501906 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tnr7p\"" Jun 13 01:04:24.502651 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.502629 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 01:04:24.502781 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.502637 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 01:04:24.513364 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.513307 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:24.514201 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.514156 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz"] Jun 13 01:04:24.600755 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.600720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-manager-config\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.600913 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.600785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-metrics-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.600913 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.600829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9z29\" (UniqueName: \"kubernetes.io/projected/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-kube-api-access-s9z29\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.600913 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.600900 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.701642 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.701543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-metrics-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.701642 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.701585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9z29\" (UniqueName: \"kubernetes.io/projected/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-kube-api-access-s9z29\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.701642 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.701635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.701893 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.701665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-manager-config\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.702481 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.702460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-manager-config\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.704315 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.704273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.704445 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.704360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-metrics-cert\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.712981 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.712957 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9z29\" (UniqueName: \"kubernetes.io/projected/e46f0758-60d4-4c66-a8d7-1fbf0bc654aa-kube-api-access-s9z29\") pod \"lws-controller-manager-6ccc6f94bf-lrgdz\" (UID: \"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa\") " pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.810090 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.810059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:24.969601 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:24.969572 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz"] Jun 13 01:04:24.971698 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:04:24.971674 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46f0758_60d4_4c66_a8d7_1fbf0bc654aa.slice/crio-841e78b1382e67bf87299d1d1736ee7a6fcd351039ff0bde39cdb24e11ffe0dd WatchSource:0}: Error finding container 841e78b1382e67bf87299d1d1736ee7a6fcd351039ff0bde39cdb24e11ffe0dd: Status 404 returned error can't find the container with id 841e78b1382e67bf87299d1d1736ee7a6fcd351039ff0bde39cdb24e11ffe0dd Jun 13 01:04:25.921436 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:25.921393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" event={"ID":"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa","Type":"ContainerStarted","Data":"841e78b1382e67bf87299d1d1736ee7a6fcd351039ff0bde39cdb24e11ffe0dd"} Jun 13 01:04:26.927225 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:26.927193 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" event={"ID":"e46f0758-60d4-4c66-a8d7-1fbf0bc654aa","Type":"ContainerStarted","Data":"317832ddb2e47fa418922f03e4ab05e8eedc5e47d88ac5810e7d479c037a73a5"} Jun 13 01:04:26.927557 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:26.927294 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:26.944335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:26.944282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" podStartSLOduration=1.774625228 podStartE2EDuration="2.944266067s" totalImagesPullingTime="1.169640839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:26.942548263 +0000 UTC m=+540.453964073" watchObservedRunningTime="2026-06-13 01:04:26.944266067 +0000 UTC m=+540.455681872" Jun 13 01:04:27.403710 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:27.403671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:27.590567 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:27.590532 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:27.702015 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:27.701921 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:28.284820 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:28.284786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:28.414260 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:28.414224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:28.692100 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:28.691989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:28.929333 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:28.929299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:29.598277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:29.598247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:29.686737 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:29.686704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:29.765877 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:29.765846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:31.905020 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:31.904987 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-zllwk" Jun 13 01:04:37.934260 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:37.934227 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ccc6f94bf-lrgdz" Jun 13 01:04:40.049379 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:40.049342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:40.157953 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:40.157916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:40.434030 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:40.433959 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:40.530378 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:40.530342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:41.575255 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:41.575214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:41.675578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:41.675543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:42.323950 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:42.323917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:42.426881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:42.426838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:43.076417 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.076384 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:43.325214 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.325183 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-69865545cf-ml7zj"] Jun 13 01:04:43.330045 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.329982 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.338031 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.338011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t8lrr\"" Jun 13 01:04:43.338477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.338458 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 01:04:43.351894 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.351863 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69865545cf-ml7zj"] Jun 13 01:04:43.380941 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.380904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:43.458266 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.458232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqp7\" (UniqueName: \"kubernetes.io/projected/96543c82-428a-40fb-b93e-4a7bd9dfbba2-kube-api-access-6qqp7\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.458437 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.458281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96543c82-428a-40fb-b93e-4a7bd9dfbba2-redirect-config\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.559629 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.559591 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqp7\" (UniqueName: \"kubernetes.io/projected/96543c82-428a-40fb-b93e-4a7bd9dfbba2-kube-api-access-6qqp7\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.559829 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.559651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96543c82-428a-40fb-b93e-4a7bd9dfbba2-redirect-config\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.560422 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.560398 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96543c82-428a-40fb-b93e-4a7bd9dfbba2-redirect-config\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.577503 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.577476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqp7\" (UniqueName: \"kubernetes.io/projected/96543c82-428a-40fb-b93e-4a7bd9dfbba2-kube-api-access-6qqp7\") pod \"dashboard-redirect-69865545cf-ml7zj\" (UID: \"96543c82-428a-40fb-b93e-4a7bd9dfbba2\") " pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.652701 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.652630 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" Jun 13 01:04:43.786963 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:43.786790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69865545cf-ml7zj"] Jun 13 01:04:43.789712 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:04:43.789684 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96543c82_428a_40fb_b93e_4a7bd9dfbba2.slice/crio-1873b392deb32b90de4d335d7128149f36b965d658342f6eaa85ab521fdb895e WatchSource:0}: Error finding container 1873b392deb32b90de4d335d7128149f36b965d658342f6eaa85ab521fdb895e: Status 404 returned error can't find the container with id 1873b392deb32b90de4d335d7128149f36b965d658342f6eaa85ab521fdb895e Jun 13 01:04:44.013215 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:44.013111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" event={"ID":"96543c82-428a-40fb-b93e-4a7bd9dfbba2","Type":"ContainerStarted","Data":"1873b392deb32b90de4d335d7128149f36b965d658342f6eaa85ab521fdb895e"} Jun 13 01:04:46.031895 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:46.031860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" event={"ID":"96543c82-428a-40fb-b93e-4a7bd9dfbba2","Type":"ContainerStarted","Data":"ed918a2737b3e5ad6878ca6d919f6be2e4224ee6643747502cce67a0376de5fb"} Jun 13 01:04:46.054434 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:46.054383 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-69865545cf-ml7zj" podStartSLOduration=1.223734083 podStartE2EDuration="3.054368664s" totalImagesPullingTime="1.830634581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:46.053397314 +0000 UTC m=+559.564813123" watchObservedRunningTime="2026-06-13 01:04:46.054368664 +0000 UTC m=+559.565784471" Jun 13 01:04:53.078612 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:53.078576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:53.167709 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:53.167678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:58.869799 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:58.869757 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:58.991123 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:58.991078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:59.710544 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:04:59.710491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:02.965920 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:02.965889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:03.064592 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.064557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:03.269228 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.269124 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22"] Jun 13 01:05:03.277384 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.277357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.279341 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.279311 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lgvgr\"" Jun 13 01:05:03.279469 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.279386 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 01:05:03.285050 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.285028 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22"] Jun 13 01:05:03.288151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.288128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:03.439277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439290 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwvvq\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-kube-api-access-nwvvq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439477 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.439728 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.439497 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.540966 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.540928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.540978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwvvq\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-kube-api-access-nwvvq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541511 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541511 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541511 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541511 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541701 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541701 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.541881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.541854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.542089 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.542066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.542339 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.542310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:03.543859 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.543832 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.543967 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.543951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.552931 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.552911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.553306 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.553288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwvvq\" (UniqueName: \"kubernetes.io/projected/5b2d258d-e3ba-49e0-ab63-25a4b134e836-kube-api-access-nwvvq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795khm22\" (UID: \"5b2d258d-e3ba-49e0-ab63-25a4b134e836\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.591091 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.591063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:03.745211 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.745053 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22"] Jun 13 01:05:03.748081 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:05:03.748055 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2d258d_e3ba_49e0_ab63_25a4b134e836.slice/crio-c1d2bdc1688a363a199666d60a0ceb41d9f790e63e225fe4f982d93fe5b4d2de WatchSource:0}: Error finding container c1d2bdc1688a363a199666d60a0ceb41d9f790e63e225fe4f982d93fe5b4d2de: Status 404 returned error can't find the container with id c1d2bdc1688a363a199666d60a0ceb41d9f790e63e225fe4f982d93fe5b4d2de Jun 13 01:05:03.765708 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:03.765675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:04.074388 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:04.074345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:04.114471 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:04.114434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" event={"ID":"5b2d258d-e3ba-49e0-ab63-25a4b134e836","Type":"ContainerStarted","Data":"c1d2bdc1688a363a199666d60a0ceb41d9f790e63e225fe4f982d93fe5b4d2de"} Jun 13 01:05:06.592414 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:06.592376 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:05:06.592803 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:06.592461 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:05:06.592803 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:06.592508 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:05:07.131186 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:07.131130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" event={"ID":"5b2d258d-e3ba-49e0-ab63-25a4b134e836","Type":"ContainerStarted","Data":"5c691fe198bd8cc148372a9ffef0a51871fd4ab57b47d57025700402c27258e1"} Jun 13 01:05:07.153572 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:07.153295 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" podStartSLOduration=1.311280566 podStartE2EDuration="4.153272059s" totalImagesPullingTime="2.841991493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:07.151996931 +0000 UTC m=+580.663412750" watchObservedRunningTime="2026-06-13 01:05:07.153272059 +0000 UTC m=+580.664687869" Jun 13 01:05:07.591607 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:07.591571 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:07.596072 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:07.596046 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:08.136057 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:08.136027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:08.137020 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:08.136999 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795khm22" Jun 13 01:05:14.972440 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:14.972406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:18.019883 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.019847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:18.108245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.108207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:18.127035 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.127007 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:18.130345 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.130328 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:18.132577 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.132550 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:05:18.132686 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.132590 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:05:18.133035 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.133019 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-69thd\"" Jun 13 01:05:18.139311 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.139277 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:18.164991 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.164961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbr6\" (UniqueName: \"kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6\") pod \"kuadrant-operator-catalog-6xxft\" (UID: \"bb6cd920-78bb-4a77-b6e3-32153debd996\") " pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:18.180108 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.180088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:18.266567 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.266476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbr6\" (UniqueName: \"kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6\") pod \"kuadrant-operator-catalog-6xxft\" (UID: \"bb6cd920-78bb-4a77-b6e3-32153debd996\") " pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:18.274134 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.274072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbr6\" (UniqueName: \"kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6\") pod \"kuadrant-operator-catalog-6xxft\" (UID: \"bb6cd920-78bb-4a77-b6e3-32153debd996\") " pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:18.441462 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.441416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:18.490967 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.490933 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:18.571442 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.571417 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:18.573836 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:05:18.573809 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6cd920_78bb_4a77_b6e3_32153debd996.slice/crio-dbf02952f8ac344b2b87ef2b3c649ef64310e1affb0fcefea4605b01521d95cb WatchSource:0}: Error finding container dbf02952f8ac344b2b87ef2b3c649ef64310e1affb0fcefea4605b01521d95cb: Status 404 returned error can't find the container with id dbf02952f8ac344b2b87ef2b3c649ef64310e1affb0fcefea4605b01521d95cb Jun 13 01:05:18.700662 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.700631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8fjk"] Jun 13 01:05:18.705150 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.705129 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:18.708991 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.708967 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8fjk"] Jun 13 01:05:18.772365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.772332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jvc\" (UniqueName: \"kubernetes.io/projected/ca65a7ea-9dc7-44b2-a4ff-49767f80b234-kube-api-access-n7jvc\") pod \"kuadrant-operator-catalog-w8fjk\" (UID: \"ca65a7ea-9dc7-44b2-a4ff-49767f80b234\") " pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:18.873473 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.873389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jvc\" (UniqueName: \"kubernetes.io/projected/ca65a7ea-9dc7-44b2-a4ff-49767f80b234-kube-api-access-n7jvc\") pod \"kuadrant-operator-catalog-w8fjk\" (UID: \"ca65a7ea-9dc7-44b2-a4ff-49767f80b234\") " pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:18.880986 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.880955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jvc\" (UniqueName: \"kubernetes.io/projected/ca65a7ea-9dc7-44b2-a4ff-49767f80b234-kube-api-access-n7jvc\") pod \"kuadrant-operator-catalog-w8fjk\" (UID: \"ca65a7ea-9dc7-44b2-a4ff-49767f80b234\") " pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:18.923894 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:18.923857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:19.015950 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:19.015918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:19.129983 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:19.129904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:19.165879 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:19.165857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8fjk"] Jun 13 01:05:19.199608 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:19.199576 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" event={"ID":"bb6cd920-78bb-4a77-b6e3-32153debd996","Type":"ContainerStarted","Data":"dbf02952f8ac344b2b87ef2b3c649ef64310e1affb0fcefea4605b01521d95cb"} Jun 13 01:05:19.205602 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:05:19.205539 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca65a7ea_9dc7_44b2_a4ff_49767f80b234.slice/crio-5a277e93477666c4f6faddd56bc1499f77638c8f816601c9a8d87cbf2b4c6ae1 WatchSource:0}: Error finding container 5a277e93477666c4f6faddd56bc1499f77638c8f816601c9a8d87cbf2b4c6ae1: Status 404 returned error can't find the container with id 5a277e93477666c4f6faddd56bc1499f77638c8f816601c9a8d87cbf2b4c6ae1 Jun 13 01:05:20.207763 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:20.207723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" event={"ID":"ca65a7ea-9dc7-44b2-a4ff-49767f80b234","Type":"ContainerStarted","Data":"5a277e93477666c4f6faddd56bc1499f77638c8f816601c9a8d87cbf2b4c6ae1"} Jun 13 01:05:21.213624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.213587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" event={"ID":"bb6cd920-78bb-4a77-b6e3-32153debd996","Type":"ContainerStarted","Data":"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038"} Jun 13 01:05:21.214090 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.213635 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" podUID="bb6cd920-78bb-4a77-b6e3-32153debd996" containerName="registry-server" containerID="cri-o://2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038" gracePeriod=2 Jun 13 01:05:21.215242 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.215219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" event={"ID":"ca65a7ea-9dc7-44b2-a4ff-49767f80b234","Type":"ContainerStarted","Data":"2d1cfedc58b231b6f6ddcbf9d3e5c880c4095b10bdca97b9a908b66b656d30c5"} Jun 13 01:05:21.229851 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.229809 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" podStartSLOduration=1.220968903 podStartE2EDuration="3.229795686s" totalImagesPullingTime="2.008826783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:21.228946047 +0000 UTC m=+594.740361857" watchObservedRunningTime="2026-06-13 01:05:21.229795686 +0000 UTC m=+594.741211492" Jun 13 01:05:21.243094 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.243056 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" podStartSLOduration=1.862999561 podStartE2EDuration="3.243042696s" totalImagesPullingTime="1.380043135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:21.241891246 +0000 UTC m=+594.753307057" watchObservedRunningTime="2026-06-13 01:05:21.243042696 +0000 UTC m=+594.754458504" Jun 13 01:05:21.455288 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.455265 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:21.497743 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.497677 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kbr6\" (UniqueName: \"kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6\") pod \"bb6cd920-78bb-4a77-b6e3-32153debd996\" (UID: \"bb6cd920-78bb-4a77-b6e3-32153debd996\") " Jun 13 01:05:21.499731 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.499710 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6" (OuterVolumeSpecName: "kube-api-access-2kbr6") pod "bb6cd920-78bb-4a77-b6e3-32153debd996" (UID: "bb6cd920-78bb-4a77-b6e3-32153debd996"). InnerVolumeSpecName "kube-api-access-2kbr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:21.598472 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:21.598440 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kbr6\" (UniqueName: \"kubernetes.io/projected/bb6cd920-78bb-4a77-b6e3-32153debd996-kube-api-access-2kbr6\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:05:22.221195 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.221145 2558 generic.go:356] "Generic (PLEG): container finished" podID="bb6cd920-78bb-4a77-b6e3-32153debd996" containerID="2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038" exitCode=0 Jun 13 01:05:22.221679 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.221206 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" Jun 13 01:05:22.221679 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.221232 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" event={"ID":"bb6cd920-78bb-4a77-b6e3-32153debd996","Type":"ContainerDied","Data":"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038"} Jun 13 01:05:22.221679 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.221283 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6xxft" event={"ID":"bb6cd920-78bb-4a77-b6e3-32153debd996","Type":"ContainerDied","Data":"dbf02952f8ac344b2b87ef2b3c649ef64310e1affb0fcefea4605b01521d95cb"} Jun 13 01:05:22.221679 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.221302 2558 scope.go:117] "RemoveContainer" containerID="2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038" Jun 13 01:05:22.230253 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.230239 2558 scope.go:117] "RemoveContainer" containerID="2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038" Jun 13 01:05:22.230497 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:05:22.230481 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038\": container with ID starting with 2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038 not found: ID does not exist" containerID="2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038" Jun 13 01:05:22.230549 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.230505 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038"} err="failed to get container status \"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038\": rpc error: code = NotFound desc = could not find container \"2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038\": container with ID starting with 2cdad94280ff9f2c286b64d9e7bded5302261a8391b99b61577d3c3c374c8038 not found: ID does not exist" Jun 13 01:05:22.241812 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.241791 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:22.243423 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.243403 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6xxft"] Jun 13 01:05:22.889275 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:22.889247 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb6cd920-78bb-4a77-b6e3-32153debd996" path="/var/lib/kubelet/pods/bb6cd920-78bb-4a77-b6e3-32153debd996/volumes" Jun 13 01:05:26.870247 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:26.870224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:05:26.871036 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:26.871010 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:05:26.875919 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:26.875900 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:05:26.876843 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:26.876820 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:05:29.017006 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:29.016971 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:29.019484 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:29.017029 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:29.039603 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:29.039579 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:29.276677 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:29.276652 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-w8fjk" Jun 13 01:05:46.982045 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:46.981938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:50.432535 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:50.432490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:50.537327 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:50.537292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:51.763464 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.763430 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4"] Jun 13 01:05:51.763856 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.763830 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6cd920-78bb-4a77-b6e3-32153debd996" containerName="registry-server" Jun 13 01:05:51.763856 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.763846 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6cd920-78bb-4a77-b6e3-32153debd996" containerName="registry-server" Jun 13 01:05:51.763927 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.763912 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6cd920-78bb-4a77-b6e3-32153debd996" containerName="registry-server" Jun 13 01:05:51.771991 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.771965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.774282 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.774258 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-57zkm\"" Jun 13 01:05:51.779018 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.778990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4"] Jun 13 01:05:51.870307 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.870248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.870503 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.870327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvtw\" (UniqueName: \"kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.971006 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.970975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.971262 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.971027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvtw\" (UniqueName: \"kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.971375 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.971355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:51.978836 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:51.978805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvtw\" (UniqueName: \"kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:52.084104 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:52.084062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:05:52.229617 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:52.229589 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4"] Jun 13 01:05:52.232639 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:05:52.232607 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2750ebb_9643_414d_badc_092933181ed8.slice/crio-321c77ff909ca2af5db469b35231c87f8a65936b9ae56c4c9ca5588e72909a2a WatchSource:0}: Error finding container 321c77ff909ca2af5db469b35231c87f8a65936b9ae56c4c9ca5588e72909a2a: Status 404 returned error can't find the container with id 321c77ff909ca2af5db469b35231c87f8a65936b9ae56c4c9ca5588e72909a2a Jun 13 01:05:52.235132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:52.235115 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:05:52.361640 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:52.361557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" event={"ID":"e2750ebb-9643-414d-badc-092933181ed8","Type":"ContainerStarted","Data":"321c77ff909ca2af5db469b35231c87f8a65936b9ae56c4c9ca5588e72909a2a"} Jun 13 01:05:52.403469 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:52.403439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:54.001239 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:54.001207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:54.417001 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:54.416971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:55.860392 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:55.860362 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:56.264250 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.262728 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kl794"] Jun 13 01:05:56.267892 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.267866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:05:56.270198 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.270161 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mbtbf\"" Jun 13 01:05:56.282737 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.282716 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kl794"] Jun 13 01:05:56.307837 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.307799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgwv2\" (UniqueName: \"kubernetes.io/projected/11633cc6-e2b8-4fa3-b201-5e1dca1ecb86-kube-api-access-wgwv2\") pod \"authorino-operator-75cc8d5cb7-kl794\" (UID: \"11633cc6-e2b8-4fa3-b201-5e1dca1ecb86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:05:56.409111 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.409079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgwv2\" (UniqueName: \"kubernetes.io/projected/11633cc6-e2b8-4fa3-b201-5e1dca1ecb86-kube-api-access-wgwv2\") pod \"authorino-operator-75cc8d5cb7-kl794\" (UID: \"11633cc6-e2b8-4fa3-b201-5e1dca1ecb86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:05:56.419016 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.418990 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgwv2\" (UniqueName: \"kubernetes.io/projected/11633cc6-e2b8-4fa3-b201-5e1dca1ecb86-kube-api-access-wgwv2\") pod \"authorino-operator-75cc8d5cb7-kl794\" (UID: \"11633cc6-e2b8-4fa3-b201-5e1dca1ecb86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:05:56.577835 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.577802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:05:56.715779 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:56.715745 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kl794"] Jun 13 01:05:56.718896 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:05:56.718868 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11633cc6_e2b8_4fa3_b201_5e1dca1ecb86.slice/crio-2918a28ec91588808f2c8bc247439150352d287739b5bf467663bb06f5d14a68 WatchSource:0}: Error finding container 2918a28ec91588808f2c8bc247439150352d287739b5bf467663bb06f5d14a68: Status 404 returned error can't find the container with id 2918a28ec91588808f2c8bc247439150352d287739b5bf467663bb06f5d14a68 Jun 13 01:05:57.389905 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:57.389865 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" event={"ID":"11633cc6-e2b8-4fa3-b201-5e1dca1ecb86","Type":"ContainerStarted","Data":"2918a28ec91588808f2c8bc247439150352d287739b5bf467663bb06f5d14a68"} Jun 13 01:05:57.399768 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:57.399739 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:58.250777 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:58.250728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:58.350800 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:05:58.350763 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:00.253518 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.253475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:00.407057 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.407018 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" event={"ID":"11633cc6-e2b8-4fa3-b201-5e1dca1ecb86","Type":"ContainerStarted","Data":"248f3bdb89d3a66f361aed607053f19866f16b32704abbda4f5a9e1a613d0983"} Jun 13 01:06:00.407335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.407143 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:06:00.409385 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.409334 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" event={"ID":"e2750ebb-9643-414d-badc-092933181ed8","Type":"ContainerStarted","Data":"44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8"} Jun 13 01:06:00.409875 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.409851 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:00.448973 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.448928 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" podStartSLOduration=1.931690573 podStartE2EDuration="9.448912111s" totalImagesPullingTime="7.517221538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:00.447735323 +0000 UTC m=+633.959151151" watchObservedRunningTime="2026-06-13 01:06:00.448912111 +0000 UTC m=+633.960327920" Jun 13 01:06:00.449894 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:00.449865 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" podStartSLOduration=1.379858358 podStartE2EDuration="4.449858747s" totalImagesPullingTime="3.070000389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:00.42967359 +0000 UTC m=+633.941089400" watchObservedRunningTime="2026-06-13 01:06:00.449858747 +0000 UTC m=+633.961274562" Jun 13 01:06:02.190692 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:02.190651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:02.292551 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:02.292515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:02.749790 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:02.749760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:02.976799 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:02.976751 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:09.625780 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:09.625743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:09.728363 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:09.728329 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:11.417021 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:11.416989 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kl794" Jun 13 01:06:12.423180 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:12.423138 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:14.372839 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.372802 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4"] Jun 13 01:06:14.373345 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.373047 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" podUID="e2750ebb-9643-414d-badc-092933181ed8" containerName="manager" containerID="cri-o://44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8" gracePeriod=2 Jun 13 01:06:14.375091 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.375063 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4"] Jun 13 01:06:14.377553 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:06:14.377524 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" is forbidden: User \"system:node:ip-10-0-140-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-23.ec2.internal' and this object" podUID="e2750ebb-9643-414d-badc-092933181ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:14.427659 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.427629 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:14.428146 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.428130 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2750ebb-9643-414d-badc-092933181ed8" containerName="manager" Jun 13 01:06:14.428214 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.428149 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2750ebb-9643-414d-badc-092933181ed8" containerName="manager" Jun 13 01:06:14.428292 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.428280 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2750ebb-9643-414d-badc-092933181ed8" containerName="manager" Jun 13 01:06:14.431526 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.431508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.433407 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:06:14.433384 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" is forbidden: User \"system:node:ip-10-0-140-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-23.ec2.internal' and this object" podUID="e2750ebb-9643-414d-badc-092933181ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:14.458135 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.458108 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:14.576317 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.576284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.576487 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.576325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5vj\" (UniqueName: \"kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.578464 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.578436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:14.618110 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.618087 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:14.620178 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:06:14.620141 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n82c4\" is forbidden: User \"system:node:ip-10-0-140-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-23.ec2.internal' and this object" podUID="e2750ebb-9643-414d-badc-092933181ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:14.676886 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.676797 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume\") pod \"e2750ebb-9643-414d-badc-092933181ed8\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " Jun 13 01:06:14.677035 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.676914 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dvtw\" (UniqueName: \"kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw\") pod \"e2750ebb-9643-414d-badc-092933181ed8\" (UID: \"e2750ebb-9643-414d-badc-092933181ed8\") " Jun 13 01:06:14.677142 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.677120 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.677228 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.677186 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5vj\" (UniqueName: \"kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.677403 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.677358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:14.677517 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.677424 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e2750ebb-9643-414d-badc-092933181ed8" (UID: "e2750ebb-9643-414d-badc-092933181ed8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:06:14.677560 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.677519 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.679302 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.679279 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw" (OuterVolumeSpecName: "kube-api-access-8dvtw") pod "e2750ebb-9643-414d-badc-092933181ed8" (UID: "e2750ebb-9643-414d-badc-092933181ed8"). InnerVolumeSpecName "kube-api-access-8dvtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:06:14.690028 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.690001 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5vj\" (UniqueName: \"kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xbrrh\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.764547 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.764527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:14.776771 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.776741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:14.777734 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.777709 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dvtw\" (UniqueName: \"kubernetes.io/projected/e2750ebb-9643-414d-badc-092933181ed8-kube-api-access-8dvtw\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:06:14.777830 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.777740 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2750ebb-9643-414d-badc-092933181ed8-extensions-socket-volume\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:06:14.889570 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.889543 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2750ebb-9643-414d-badc-092933181ed8" path="/var/lib/kubelet/pods/e2750ebb-9643-414d-badc-092933181ed8/volumes" Jun 13 01:06:14.921728 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:14.921706 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:14.924320 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:06:14.924294 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b5a01d_7789_4aa6_9896_7d28a7613f03.slice/crio-606d1560945e6555ebb94b5bffe46d6764553c131fe43ba225584debf4f99466 WatchSource:0}: Error finding container 606d1560945e6555ebb94b5bffe46d6764553c131fe43ba225584debf4f99466: Status 404 returned error can't find the container with id 606d1560945e6555ebb94b5bffe46d6764553c131fe43ba225584debf4f99466 Jun 13 01:06:15.494459 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.494430 2558 generic.go:356] "Generic (PLEG): container finished" podID="e2750ebb-9643-414d-badc-092933181ed8" containerID="44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8" exitCode=0 Jun 13 01:06:15.494938 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.494473 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n82c4" Jun 13 01:06:15.494938 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.494539 2558 scope.go:117] "RemoveContainer" containerID="44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8" Jun 13 01:06:15.496448 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.496409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" event={"ID":"e9b5a01d-7789-4aa6-9896-7d28a7613f03","Type":"ContainerStarted","Data":"7638ee526c16c81d4031fd9fe964c5dd2b36650c8fd9c9d6d71fc0133386c450"} Jun 13 01:06:15.496577 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.496473 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" event={"ID":"e9b5a01d-7789-4aa6-9896-7d28a7613f03","Type":"ContainerStarted","Data":"606d1560945e6555ebb94b5bffe46d6764553c131fe43ba225584debf4f99466"} Jun 13 01:06:15.496791 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.496774 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:15.503471 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.503455 2558 scope.go:117] "RemoveContainer" containerID="44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8" Jun 13 01:06:15.503695 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:06:15.503677 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8\": container with ID starting with 44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8 not found: ID does not exist" containerID="44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8" Jun 13 01:06:15.503762 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:15.503703 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8"} err="failed to get container status \"44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8\": rpc error: code = NotFound desc = could not find container \"44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8\": container with ID starting with 44b14b7affc637c89cf63d5fb68ad2b4ebc92a5e21c54f1ec9afc4786b44c6c8 not found: ID does not exist" Jun 13 01:06:16.976151 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:16.976119 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:17.081864 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:17.081832 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:19.427632 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:19.427602 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:19.581578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:19.581546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:19.679846 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:19.679769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:22.422645 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:22.422609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:22.523133 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:22.523097 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:26.504783 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:26.504749 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:26.527775 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:26.527543 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" podStartSLOduration=12.52752425 podStartE2EDuration="12.52752425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:06:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:15.531716247 +0000 UTC m=+649.043132056" watchObservedRunningTime="2026-06-13 01:06:26.52752425 +0000 UTC m=+660.038940062" Jun 13 01:06:29.338762 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:29.338719 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:29.439055 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:29.439022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:31.367481 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.367446 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:31.367890 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.367644 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" podUID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" containerName="manager" containerID="cri-o://7638ee526c16c81d4031fd9fe964c5dd2b36650c8fd9c9d6d71fc0133386c450" gracePeriod=10 Jun 13 01:06:31.582492 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.582465 2558 generic.go:356] "Generic (PLEG): container finished" podID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" containerID="7638ee526c16c81d4031fd9fe964c5dd2b36650c8fd9c9d6d71fc0133386c450" exitCode=0 Jun 13 01:06:31.582633 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.582529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" event={"ID":"e9b5a01d-7789-4aa6-9896-7d28a7613f03","Type":"ContainerDied","Data":"7638ee526c16c81d4031fd9fe964c5dd2b36650c8fd9c9d6d71fc0133386c450"} Jun 13 01:06:31.636685 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.636626 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:31.658222 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.658191 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7"] Jun 13 01:06:31.658546 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.658533 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" containerName="manager" Jun 13 01:06:31.658595 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.658548 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" containerName="manager" Jun 13 01:06:31.658635 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.658625 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" containerName="manager" Jun 13 01:06:31.661532 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.661517 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.702624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.702590 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7"] Jun 13 01:06:31.731212 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.731162 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume\") pod \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " Jun 13 01:06:31.731361 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.731223 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz5vj\" (UniqueName: \"kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj\") pod \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\" (UID: \"e9b5a01d-7789-4aa6-9896-7d28a7613f03\") " Jun 13 01:06:31.731579 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.731554 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9b5a01d-7789-4aa6-9896-7d28a7613f03" (UID: "e9b5a01d-7789-4aa6-9896-7d28a7613f03"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:06:31.733366 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.733345 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj" (OuterVolumeSpecName: "kube-api-access-jz5vj") pod "e9b5a01d-7789-4aa6-9896-7d28a7613f03" (UID: "e9b5a01d-7789-4aa6-9896-7d28a7613f03"). InnerVolumeSpecName "kube-api-access-jz5vj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:06:31.832535 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.832507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c6485e7-c586-4e1e-90a8-661b40a32cdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.832656 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.832570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5zw\" (UniqueName: \"kubernetes.io/projected/7c6485e7-c586-4e1e-90a8-661b40a32cdf-kube-api-access-bg5zw\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.832697 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.832669 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b5a01d-7789-4aa6-9896-7d28a7613f03-extensions-socket-volume\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:06:31.832697 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.832687 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz5vj\" (UniqueName: \"kubernetes.io/projected/e9b5a01d-7789-4aa6-9896-7d28a7613f03-kube-api-access-jz5vj\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:06:31.933732 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.933652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5zw\" (UniqueName: \"kubernetes.io/projected/7c6485e7-c586-4e1e-90a8-661b40a32cdf-kube-api-access-bg5zw\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.933732 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.933717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c6485e7-c586-4e1e-90a8-661b40a32cdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.934028 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.934008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c6485e7-c586-4e1e-90a8-661b40a32cdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.943238 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.943208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5zw\" (UniqueName: \"kubernetes.io/projected/7c6485e7-c586-4e1e-90a8-661b40a32cdf-kube-api-access-bg5zw\") pod \"kuadrant-operator-controller-manager-86878c769f-gm2x7\" (UID: \"7c6485e7-c586-4e1e-90a8-661b40a32cdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:31.972015 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:31.971992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:32.118803 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.118777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7"] Jun 13 01:06:32.120846 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:06:32.120815 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6485e7_c586_4e1e_90a8_661b40a32cdf.slice/crio-f68bbab040fc15760b0fcff83e0224de91a7be38c92819e046e2724499052f8a WatchSource:0}: Error finding container f68bbab040fc15760b0fcff83e0224de91a7be38c92819e046e2724499052f8a: Status 404 returned error can't find the container with id f68bbab040fc15760b0fcff83e0224de91a7be38c92819e046e2724499052f8a Jun 13 01:06:32.588433 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.588407 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" Jun 13 01:06:32.588886 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.588447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh" event={"ID":"e9b5a01d-7789-4aa6-9896-7d28a7613f03","Type":"ContainerDied","Data":"606d1560945e6555ebb94b5bffe46d6764553c131fe43ba225584debf4f99466"} Jun 13 01:06:32.588886 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.588505 2558 scope.go:117] "RemoveContainer" containerID="7638ee526c16c81d4031fd9fe964c5dd2b36650c8fd9c9d6d71fc0133386c450" Jun 13 01:06:32.590329 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.590290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" event={"ID":"7c6485e7-c586-4e1e-90a8-661b40a32cdf","Type":"ContainerStarted","Data":"3db0e68eeb4060b7a27517f0e475c632df469b43e373a16e51e857a3977bfbb8"} Jun 13 01:06:32.590463 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.590352 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" event={"ID":"7c6485e7-c586-4e1e-90a8-661b40a32cdf","Type":"ContainerStarted","Data":"f68bbab040fc15760b0fcff83e0224de91a7be38c92819e046e2724499052f8a"} Jun 13 01:06:32.590463 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.590386 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:32.620161 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.620111 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" podStartSLOduration=1.6200965969999999 podStartE2EDuration="1.620096597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:32.617964699 +0000 UTC m=+666.129380520" watchObservedRunningTime="2026-06-13 01:06:32.620096597 +0000 UTC m=+666.131512406" Jun 13 01:06:32.637891 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.637863 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:32.645199 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.643647 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xbrrh"] Jun 13 01:06:32.890067 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:32.889977 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b5a01d-7789-4aa6-9896-7d28a7613f03" path="/var/lib/kubelet/pods/e9b5a01d-7789-4aa6-9896-7d28a7613f03/volumes" Jun 13 01:06:34.141045 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:34.141010 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:34.239079 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:34.239046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:36.589232 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:36.589204 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:36.691836 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:36.691801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:42.354400 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:42.354370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:42.420547 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:42.420513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:43.598867 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:43.598834 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gm2x7" Jun 13 01:06:47.761035 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.761003 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv"] Jun 13 01:06:47.763843 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.763826 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.766653 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.766632 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-54k6v\"" Jun 13 01:06:47.778239 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.778217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv"] Jun 13 01:06:47.786773 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.786739 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:47.861944 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.861894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.861965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.861996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862132 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862297 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862297 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862297 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.862297 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.862250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qmhq\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-kube-api-access-6qmhq\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.962868 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.962834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.962868 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.962871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.962892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.962921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.962947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963423 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qmhq\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-kube-api-access-6qmhq\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963423 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963423 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963571 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963571 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963743 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.963847 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.963830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.965399 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.965377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.965695 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.965677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.970111 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.970090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qmhq\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-kube-api-access-6qmhq\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.970453 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.970432 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9aee6cd-9a74-40d3-a0dc-0f7a3426e240-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m42pv\" (UID: \"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:47.977499 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:47.977474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:48.074259 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.074215 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:48.212990 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.212962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv"] Jun 13 01:06:48.215144 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:06:48.215115 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9aee6cd_9a74_40d3_a0dc_0f7a3426e240.slice/crio-43fcde7825fe10433e0d5aa496385e2bb8e3e63dbecbdcfbf2d96b19b92850f3 WatchSource:0}: Error finding container 43fcde7825fe10433e0d5aa496385e2bb8e3e63dbecbdcfbf2d96b19b92850f3: Status 404 returned error can't find the container with id 43fcde7825fe10433e0d5aa496385e2bb8e3e63dbecbdcfbf2d96b19b92850f3 Jun 13 01:06:48.217474 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.217431 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:06:48.217546 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.217529 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:06:48.217601 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.217585 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:06:48.671838 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.671799 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" event={"ID":"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240","Type":"ContainerStarted","Data":"6e3b6d87226d52af982d2deb297e9a951673a8f999c165080b2aca604fdfefca"} Jun 13 01:06:48.672021 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.671862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" event={"ID":"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240","Type":"ContainerStarted","Data":"43fcde7825fe10433e0d5aa496385e2bb8e3e63dbecbdcfbf2d96b19b92850f3"} Jun 13 01:06:48.694390 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:48.694334 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" podStartSLOduration=1.694316546 podStartE2EDuration="1.694316546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:48.693265679 +0000 UTC m=+682.204681507" watchObservedRunningTime="2026-06-13 01:06:48.694316546 +0000 UTC m=+682.205732355" Jun 13 01:06:49.074664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:49.074632 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:49.079702 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:49.079679 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:49.677252 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:49.677214 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:49.678298 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:49.678276 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:06:50.344031 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:50.343994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:50.448851 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:50.448810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:54.939685 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:54.939641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:55.036525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:55.036493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:55.138496 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:55.138463 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:55.198642 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:55.198547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:57.945235 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:57.945190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:58.017871 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:06:58.017841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:04.466902 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:04.466861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:04.581159 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:04.581116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:04.652086 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:04.652054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:05.260237 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.260204 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:05.264140 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.264117 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:05.266457 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.266434 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cd2w7\"" Jun 13 01:07:05.269896 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.269867 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:05.299983 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.299950 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:05.340245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.340222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5drq\" (UniqueName: \"kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq\") pod \"authorino-58cd955675-bq497\" (UID: \"872dbf1d-0728-414d-9821-b45d4fa676a5\") " pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:05.399699 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.399675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:05.441582 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.441548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5drq\" (UniqueName: \"kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq\") pod \"authorino-58cd955675-bq497\" (UID: \"872dbf1d-0728-414d-9821-b45d4fa676a5\") " pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:05.452647 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.452614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5drq\" (UniqueName: \"kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq\") pod \"authorino-58cd955675-bq497\" (UID: \"872dbf1d-0728-414d-9821-b45d4fa676a5\") " pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:05.458095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.458070 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:07:05.461667 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.461649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:07:05.467632 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.467609 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:07:05.542252 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.542230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8hg\" (UniqueName: \"kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg\") pod \"authorino-75d556bd77-sfgb8\" (UID: \"356e10b6-0a39-4fd9-aba5-e05c1e694975\") " pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:07:05.575338 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.575299 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:05.643257 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.643229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8hg\" (UniqueName: \"kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg\") pod \"authorino-75d556bd77-sfgb8\" (UID: \"356e10b6-0a39-4fd9-aba5-e05c1e694975\") " pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:07:05.651116 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.651058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8hg\" (UniqueName: \"kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg\") pod \"authorino-75d556bd77-sfgb8\" (UID: \"356e10b6-0a39-4fd9-aba5-e05c1e694975\") " pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:07:05.711961 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.711934 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:05.714500 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:07:05.714477 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod872dbf1d_0728_414d_9821_b45d4fa676a5.slice/crio-fed9e1436f6b8351e2995eac9b89299ea9260554c5660e8c00150e3a706e0f14 WatchSource:0}: Error finding container fed9e1436f6b8351e2995eac9b89299ea9260554c5660e8c00150e3a706e0f14: Status 404 returned error can't find the container with id fed9e1436f6b8351e2995eac9b89299ea9260554c5660e8c00150e3a706e0f14 Jun 13 01:07:05.769095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.769056 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bq497" event={"ID":"872dbf1d-0728-414d-9821-b45d4fa676a5","Type":"ContainerStarted","Data":"fed9e1436f6b8351e2995eac9b89299ea9260554c5660e8c00150e3a706e0f14"} Jun 13 01:07:05.772332 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.772316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:07:05.909618 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:05.909580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:07:05.911851 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:07:05.911824 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356e10b6_0a39_4fd9_aba5_e05c1e694975.slice/crio-763b43644b7d819ae8a8744789a25dd9354d9960bee515d281d0dde42aede50c WatchSource:0}: Error finding container 763b43644b7d819ae8a8744789a25dd9354d9960bee515d281d0dde42aede50c: Status 404 returned error can't find the container with id 763b43644b7d819ae8a8744789a25dd9354d9960bee515d281d0dde42aede50c Jun 13 01:07:06.789165 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:06.789128 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sfgb8" event={"ID":"356e10b6-0a39-4fd9-aba5-e05c1e694975","Type":"ContainerStarted","Data":"763b43644b7d819ae8a8744789a25dd9354d9960bee515d281d0dde42aede50c"} Jun 13 01:07:09.806394 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:09.806322 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bq497" event={"ID":"872dbf1d-0728-414d-9821-b45d4fa676a5","Type":"ContainerStarted","Data":"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4"} Jun 13 01:07:09.807964 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:09.807922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sfgb8" event={"ID":"356e10b6-0a39-4fd9-aba5-e05c1e694975","Type":"ContainerStarted","Data":"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4"} Jun 13 01:07:09.822984 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:09.822935 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bq497" podStartSLOduration=1.599343849 podStartE2EDuration="4.822920007s" totalImagesPullingTime="3.223576158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:07:09.820547083 +0000 UTC m=+703.331962898" watchObservedRunningTime="2026-06-13 01:07:09.822920007 +0000 UTC m=+703.334335816" Jun 13 01:07:09.837285 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:09.836996 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sfgb8" podStartSLOduration=1.798950445 podStartE2EDuration="4.836980232s" totalImagesPullingTime="3.038029787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:07:09.835636486 +0000 UTC m=+703.347052297" watchObservedRunningTime="2026-06-13 01:07:09.836980232 +0000 UTC m=+703.348396041" Jun 13 01:07:09.867115 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:09.867074 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:10.798965 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:10.798930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:10.899488 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:10.899450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:10.999456 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:10.999419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:11.758007 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:11.757975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:11.817376 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:11.817340 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bq497" podUID="872dbf1d-0728-414d-9821-b45d4fa676a5" containerName="authorino" containerID="cri-o://a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4" gracePeriod=30 Jun 13 01:07:11.835937 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:11.835916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:12.066694 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.066667 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:12.205247 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.205215 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5drq\" (UniqueName: \"kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq\") pod \"872dbf1d-0728-414d-9821-b45d4fa676a5\" (UID: \"872dbf1d-0728-414d-9821-b45d4fa676a5\") " Jun 13 01:07:12.207304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.207281 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq" (OuterVolumeSpecName: "kube-api-access-g5drq") pod "872dbf1d-0728-414d-9821-b45d4fa676a5" (UID: "872dbf1d-0728-414d-9821-b45d4fa676a5"). InnerVolumeSpecName "kube-api-access-g5drq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:07:12.305929 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.305842 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5drq\" (UniqueName: \"kubernetes.io/projected/872dbf1d-0728-414d-9821-b45d4fa676a5-kube-api-access-g5drq\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:12.823259 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.823222 2558 generic.go:356] "Generic (PLEG): container finished" podID="872dbf1d-0728-414d-9821-b45d4fa676a5" containerID="a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4" exitCode=0 Jun 13 01:07:12.823455 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.823269 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bq497" Jun 13 01:07:12.823455 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.823303 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bq497" event={"ID":"872dbf1d-0728-414d-9821-b45d4fa676a5","Type":"ContainerDied","Data":"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4"} Jun 13 01:07:12.823455 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.823341 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bq497" event={"ID":"872dbf1d-0728-414d-9821-b45d4fa676a5","Type":"ContainerDied","Data":"fed9e1436f6b8351e2995eac9b89299ea9260554c5660e8c00150e3a706e0f14"} Jun 13 01:07:12.823455 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.823359 2558 scope.go:117] "RemoveContainer" containerID="a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4" Jun 13 01:07:12.833373 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.833357 2558 scope.go:117] "RemoveContainer" containerID="a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4" Jun 13 01:07:12.833630 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:07:12.833614 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4\": container with ID starting with a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4 not found: ID does not exist" containerID="a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4" Jun 13 01:07:12.833728 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.833640 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4"} err="failed to get container status \"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4\": rpc error: code = NotFound desc = could not find container \"a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4\": container with ID starting with a7490975fc6d44c0381e5ccf5054f200d728a09b127c89dfe1ccd5810bb6a7d4 not found: ID does not exist" Jun 13 01:07:12.845104 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.845083 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:12.848486 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.848467 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bq497"] Jun 13 01:07:12.888922 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:12.888899 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="872dbf1d-0728-414d-9821-b45d4fa676a5" path="/var/lib/kubelet/pods/872dbf1d-0728-414d-9821-b45d4fa676a5/volumes" Jun 13 01:07:21.283278 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:21.283239 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:07:21.384811 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:21.384766 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:21.438274 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:21.438241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:21.989923 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:21.989889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:30.997161 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:30.997124 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:31.095927 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:31.095892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:31.236475 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:31.236435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:46.306668 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.306623 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c6f5f9db7-7w58d" podUID="8fa6d834-5b87-420f-857a-60cafbc7f337" containerName="console" containerID="cri-o://7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d" gracePeriod=15 Jun 13 01:07:46.558493 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.558437 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:07:46.698720 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698691 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrnk8\" (UniqueName: \"kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.698908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698739 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.698908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698787 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.698908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698819 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.698908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698838 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.698908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.698888 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.699203 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699016 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config\") pod \"8fa6d834-5b87-420f-857a-60cafbc7f337\" (UID: \"8fa6d834-5b87-420f-857a-60cafbc7f337\") " Jun 13 01:07:46.699294 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699266 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca" (OuterVolumeSpecName: "service-ca") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:07:46.699294 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699277 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:07:46.699403 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699304 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:07:46.699403 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699392 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-service-ca\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.699504 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699460 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-trusted-ca-bundle\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.699504 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699477 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-oauth-serving-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.699610 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.699563 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config" (OuterVolumeSpecName: "console-config") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:07:46.700930 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.700903 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8" (OuterVolumeSpecName: "kube-api-access-zrnk8") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "kube-api-access-zrnk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:07:46.701048 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.700951 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:07:46.701097 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.701067 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8fa6d834-5b87-420f-857a-60cafbc7f337" (UID: "8fa6d834-5b87-420f-857a-60cafbc7f337"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:07:46.800395 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.800366 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-serving-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.800395 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.800390 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa6d834-5b87-420f-857a-60cafbc7f337-console-config\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.800395 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.800400 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrnk8\" (UniqueName: \"kubernetes.io/projected/8fa6d834-5b87-420f-857a-60cafbc7f337-kube-api-access-zrnk8\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.800580 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.800408 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa6d834-5b87-420f-857a-60cafbc7f337-console-oauth-config\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:07:46.994066 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.994033 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fa6d834-5b87-420f-857a-60cafbc7f337" containerID="7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d" exitCode=0 Jun 13 01:07:46.994233 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.994069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f5f9db7-7w58d" event={"ID":"8fa6d834-5b87-420f-857a-60cafbc7f337","Type":"ContainerDied","Data":"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d"} Jun 13 01:07:46.994233 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.994117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6f5f9db7-7w58d" event={"ID":"8fa6d834-5b87-420f-857a-60cafbc7f337","Type":"ContainerDied","Data":"67607dfa828dede80740686e09757eccdff35c0f9734020331916b5ade007cc4"} Jun 13 01:07:46.994233 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.994136 2558 scope.go:117] "RemoveContainer" containerID="7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d" Jun 13 01:07:46.994233 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:46.994077 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6f5f9db7-7w58d" Jun 13 01:07:47.003335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:47.003319 2558 scope.go:117] "RemoveContainer" containerID="7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d" Jun 13 01:07:47.003652 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:07:47.003623 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d\": container with ID starting with 7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d not found: ID does not exist" containerID="7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d" Jun 13 01:07:47.003732 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:47.003663 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d"} err="failed to get container status \"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d\": rpc error: code = NotFound desc = could not find container \"7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d\": container with ID starting with 7883944d081235cfa818206b7f717119d12833596b4d81b1079b24e689537f5d not found: ID does not exist" Jun 13 01:07:47.024022 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:47.023995 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:07:47.026192 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:47.026142 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6f5f9db7-7w58d"] Jun 13 01:07:48.888960 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:48.888926 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa6d834-5b87-420f-857a-60cafbc7f337" path="/var/lib/kubelet/pods/8fa6d834-5b87-420f-857a-60cafbc7f337/volumes" Jun 13 01:07:49.222575 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:49.222495 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:49.344727 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:49.344698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:58.715258 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:07:58.715227 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:00.488879 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.488844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:00.589402 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.589371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:00.895296 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895262 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:00.895621 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895608 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872dbf1d-0728-414d-9821-b45d4fa676a5" containerName="authorino" Jun 13 01:08:00.895672 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895623 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="872dbf1d-0728-414d-9821-b45d4fa676a5" containerName="authorino" Jun 13 01:08:00.895672 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895637 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa6d834-5b87-420f-857a-60cafbc7f337" containerName="console" Jun 13 01:08:00.895672 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895642 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa6d834-5b87-420f-857a-60cafbc7f337" containerName="console" Jun 13 01:08:00.895767 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895705 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="872dbf1d-0728-414d-9821-b45d4fa676a5" containerName="authorino" Jun 13 01:08:00.895767 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.895716 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa6d834-5b87-420f-857a-60cafbc7f337" containerName="console" Jun 13 01:08:00.900226 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.900210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:00.902145 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.902125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:08:00.902245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.902163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:08:00.902245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.902181 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:08:00.902325 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.902300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w8f5f\"" Jun 13 01:08:00.906397 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:00.906364 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:01.024550 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:01.024510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmdw\" (UniqueName: \"kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw\") pod \"maas-keycloak-0\" (UID: \"81596e1f-1379-43df-abbe-bdcb7e7efc58\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:01.125206 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:01.125154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmdw\" (UniqueName: \"kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw\") pod \"maas-keycloak-0\" (UID: \"81596e1f-1379-43df-abbe-bdcb7e7efc58\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:01.132128 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:01.132099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmdw\" (UniqueName: \"kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw\") pod \"maas-keycloak-0\" (UID: \"81596e1f-1379-43df-abbe-bdcb7e7efc58\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:01.211325 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:01.211233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:01.345996 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:01.345972 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:01.348531 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:08:01.348502 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81596e1f_1379_43df_abbe_bdcb7e7efc58.slice/crio-0efc5f70dc5d5c552a353a1930683c6c70767bb5416554cc75e9dc9fa2409578 WatchSource:0}: Error finding container 0efc5f70dc5d5c552a353a1930683c6c70767bb5416554cc75e9dc9fa2409578: Status 404 returned error can't find the container with id 0efc5f70dc5d5c552a353a1930683c6c70767bb5416554cc75e9dc9fa2409578 Jun 13 01:08:02.069598 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:02.069519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"81596e1f-1379-43df-abbe-bdcb7e7efc58","Type":"ContainerStarted","Data":"0efc5f70dc5d5c552a353a1930683c6c70767bb5416554cc75e9dc9fa2409578"} Jun 13 01:08:06.095647 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:06.095604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"81596e1f-1379-43df-abbe-bdcb7e7efc58","Type":"ContainerStarted","Data":"7bd728e0e0f7bc7fc3e9af3bbb4ef99ade1a9fd3ed03e1707f6e8450c90f785a"} Jun 13 01:08:06.111965 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:06.111906 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.7871275469999999 podStartE2EDuration="6.111884562s" totalImagesPullingTime="4.324757015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:06.110277604 +0000 UTC m=+759.621693415" watchObservedRunningTime="2026-06-13 01:08:06.111884562 +0000 UTC m=+759.623300372" Jun 13 01:08:06.212223 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:06.212162 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:06.213875 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:06.213841 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:07.212678 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:07.212634 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:08.212214 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:08.212075 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:09.212306 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:09.212255 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:10.212324 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:10.212268 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:11.212350 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:11.212300 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:11.213392 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:11.213351 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:12.212274 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:12.212219 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:13.211958 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:13.211909 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:14.212495 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:14.212455 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:15.212164 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:15.212124 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:16.211805 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:16.211763 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:17.212386 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:17.212337 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:18.212106 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:18.212068 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 13 01:08:19.326898 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:19.326851 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:19.345567 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:19.345253 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:08:29.333996 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:29.333963 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:29.991873 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:29.991841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:30.220773 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.220733 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw58b"] Jun 13 01:08:30.230411 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.230381 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw58b"] Jun 13 01:08:30.230568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.230461 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:30.278365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.278337 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:30.316795 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.316762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckkb2\" (UniqueName: \"kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2\") pod \"authorino-5d4b67c446-kw58b\" (UID: \"c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163\") " pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:30.413302 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.413268 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw58b"] Jun 13 01:08:30.413650 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:08:30.413519 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ckkb2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-kw58b" podUID="c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163" Jun 13 01:08:30.417290 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.417263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckkb2\" (UniqueName: \"kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2\") pod \"authorino-5d4b67c446-kw58b\" (UID: \"c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163\") " pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:30.425147 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.425118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckkb2\" (UniqueName: \"kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2\") pod \"authorino-5d4b67c446-kw58b\" (UID: \"c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163\") " pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:30.438772 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.438738 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-4s48k"] Jun 13 01:08:30.442034 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.442014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.443807 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.443792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 01:08:30.449184 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.449150 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-4s48k"] Jun 13 01:08:30.466786 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.466745 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4s48k"] Jun 13 01:08:30.467037 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:08:30.467017 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sk4d5 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-4s48k" podUID="0803476e-709a-407e-86ec-3720a5d64677" Jun 13 01:08:30.494906 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.494881 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:08:30.498115 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.498100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.505716 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.505687 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:08:30.517820 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.517786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.517934 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.517880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4d5\" (UniqueName: \"kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.619148 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.619074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4d5\" (UniqueName: \"kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.619148 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.619112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.619148 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.619132 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whncr\" (UniqueName: \"kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.619396 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.619261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.621667 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.621636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.626567 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.626542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4d5\" (UniqueName: \"kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5\") pod \"authorino-76877994-4s48k\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:30.720587 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.720561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.720727 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.720594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whncr\" (UniqueName: \"kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.722881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.722851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.727706 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.727686 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whncr\" (UniqueName: \"kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr\") pod \"authorino-56c8fdc795-v6kbq\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.808780 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.808748 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:08:30.937902 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:30.937875 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:08:30.940011 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:08:30.939986 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd5ec224_8f3d_48cc_86db_24fa2c92e204.slice/crio-c04c7dd35c78bf03a4d55286bf460f0accaa14d9a3e422b377f26454ef5e2115 WatchSource:0}: Error finding container c04c7dd35c78bf03a4d55286bf460f0accaa14d9a3e422b377f26454ef5e2115: Status 404 returned error can't find the container with id c04c7dd35c78bf03a4d55286bf460f0accaa14d9a3e422b377f26454ef5e2115 Jun 13 01:08:31.256049 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.256029 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:31.256157 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.256055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:31.256157 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.256029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" event={"ID":"fd5ec224-8f3d-48cc-86db-24fa2c92e204","Type":"ContainerStarted","Data":"c04c7dd35c78bf03a4d55286bf460f0accaa14d9a3e422b377f26454ef5e2115"} Jun 13 01:08:31.272980 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.272962 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:31.276361 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.276343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:31.427709 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.427672 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckkb2\" (UniqueName: \"kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2\") pod \"c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163\" (UID: \"c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163\") " Jun 13 01:08:31.427709 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.427703 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk4d5\" (UniqueName: \"kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5\") pod \"0803476e-709a-407e-86ec-3720a5d64677\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " Jun 13 01:08:31.428254 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.427767 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert\") pod \"0803476e-709a-407e-86ec-3720a5d64677\" (UID: \"0803476e-709a-407e-86ec-3720a5d64677\") " Jun 13 01:08:31.429840 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.429806 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0803476e-709a-407e-86ec-3720a5d64677" (UID: "0803476e-709a-407e-86ec-3720a5d64677"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:08:31.429974 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.429860 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2" (OuterVolumeSpecName: "kube-api-access-ckkb2") pod "c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163" (UID: "c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163"). InnerVolumeSpecName "kube-api-access-ckkb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:08:31.429974 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.429873 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5" (OuterVolumeSpecName: "kube-api-access-sk4d5") pod "0803476e-709a-407e-86ec-3720a5d64677" (UID: "0803476e-709a-407e-86ec-3720a5d64677"). InnerVolumeSpecName "kube-api-access-sk4d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:08:31.529189 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.529138 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0803476e-709a-407e-86ec-3720a5d64677-tls-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:08:31.529189 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.529188 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckkb2\" (UniqueName: \"kubernetes.io/projected/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163-kube-api-access-ckkb2\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:08:31.529372 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:31.529204 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk4d5\" (UniqueName: \"kubernetes.io/projected/0803476e-709a-407e-86ec-3720a5d64677-kube-api-access-sk4d5\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:08:32.262715 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.262684 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw58b" Jun 13 01:08:32.262934 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.262730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" event={"ID":"fd5ec224-8f3d-48cc-86db-24fa2c92e204","Type":"ContainerStarted","Data":"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1"} Jun 13 01:08:32.262934 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.262868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4s48k" Jun 13 01:08:32.276908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.276868 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" podStartSLOduration=1.983372586 podStartE2EDuration="2.276854928s" totalImagesPullingTime="293.482342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:32.275784461 +0000 UTC m=+785.787200269" watchObservedRunningTime="2026-06-13 01:08:32.276854928 +0000 UTC m=+785.788270736" Jun 13 01:08:32.301325 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.301297 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw58b"] Jun 13 01:08:32.305622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.305598 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:08:32.305806 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.305785 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sfgb8" podUID="356e10b6-0a39-4fd9-aba5-e05c1e694975" containerName="authorino" containerID="cri-o://d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4" gracePeriod=30 Jun 13 01:08:32.307670 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.307646 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw58b"] Jun 13 01:08:32.327914 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.327888 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4s48k"] Jun 13 01:08:32.330603 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.330580 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-4s48k"] Jun 13 01:08:32.563554 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.563524 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:08:32.637163 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.637138 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8hg\" (UniqueName: \"kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg\") pod \"356e10b6-0a39-4fd9-aba5-e05c1e694975\" (UID: \"356e10b6-0a39-4fd9-aba5-e05c1e694975\") " Jun 13 01:08:32.639181 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.639140 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg" (OuterVolumeSpecName: "kube-api-access-cc8hg") pod "356e10b6-0a39-4fd9-aba5-e05c1e694975" (UID: "356e10b6-0a39-4fd9-aba5-e05c1e694975"). InnerVolumeSpecName "kube-api-access-cc8hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:08:32.738620 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.738580 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc8hg\" (UniqueName: \"kubernetes.io/projected/356e10b6-0a39-4fd9-aba5-e05c1e694975-kube-api-access-cc8hg\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:08:32.897206 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.897095 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0803476e-709a-407e-86ec-3720a5d64677" path="/var/lib/kubelet/pods/0803476e-709a-407e-86ec-3720a5d64677/volumes" Jun 13 01:08:32.897430 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:32.897415 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163" path="/var/lib/kubelet/pods/c6a261ee-4d9f-47b7-b9a1-2b4c2e9a7163/volumes" Jun 13 01:08:33.270216 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.270101 2558 generic.go:356] "Generic (PLEG): container finished" podID="356e10b6-0a39-4fd9-aba5-e05c1e694975" containerID="d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4" exitCode=0 Jun 13 01:08:33.270216 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.270138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sfgb8" event={"ID":"356e10b6-0a39-4fd9-aba5-e05c1e694975","Type":"ContainerDied","Data":"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4"} Jun 13 01:08:33.270216 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.270197 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sfgb8" Jun 13 01:08:33.270523 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.270226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sfgb8" event={"ID":"356e10b6-0a39-4fd9-aba5-e05c1e694975","Type":"ContainerDied","Data":"763b43644b7d819ae8a8744789a25dd9354d9960bee515d281d0dde42aede50c"} Jun 13 01:08:33.270523 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.270251 2558 scope.go:117] "RemoveContainer" containerID="d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4" Jun 13 01:08:33.280549 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.280530 2558 scope.go:117] "RemoveContainer" containerID="d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4" Jun 13 01:08:33.280888 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:08:33.280869 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4\": container with ID starting with d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4 not found: ID does not exist" containerID="d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4" Jun 13 01:08:33.280954 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.280897 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4"} err="failed to get container status \"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4\": rpc error: code = NotFound desc = could not find container \"d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4\": container with ID starting with d2407cd2f833b82bfa291df24f2adce2eb35a47385c2673b5cf4bd8a7db663c4 not found: ID does not exist" Jun 13 01:08:33.288057 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.288037 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:08:33.293153 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:33.293134 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sfgb8"] Jun 13 01:08:34.889198 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:34.889152 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356e10b6-0a39-4fd9-aba5-e05c1e694975" path="/var/lib/kubelet/pods/356e10b6-0a39-4fd9-aba5-e05c1e694975/volumes" Jun 13 01:08:35.815868 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:35.815837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:36.030601 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:36.030566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:36.273773 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:36.273690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:39.422837 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:39.422721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:39.520409 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:08:39.520374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:10.410340 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.410304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:10.849056 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.849025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:10.951445 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.951415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:10.957958 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.957931 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgqmb"] Jun 13 01:09:10.958365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.958351 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356e10b6-0a39-4fd9-aba5-e05c1e694975" containerName="authorino" Jun 13 01:09:10.958418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.958367 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="356e10b6-0a39-4fd9-aba5-e05c1e694975" containerName="authorino" Jun 13 01:09:10.958454 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.958423 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="356e10b6-0a39-4fd9-aba5-e05c1e694975" containerName="authorino" Jun 13 01:09:10.961041 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.961022 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:10.963381 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.963357 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 01:09:10.971799 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:10.971773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgqmb"] Jun 13 01:09:11.053087 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.053050 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:11.058321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.058292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mpj\" (UniqueName: \"kubernetes.io/projected/654e707c-80ac-4c82-830c-0da1b878de2f-kube-api-access-45mpj\") pod \"payload-pre-processing-579785bc64-lgqmb\" (UID: \"654e707c-80ac-4c82-830c-0da1b878de2f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:11.159391 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.159242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mpj\" (UniqueName: \"kubernetes.io/projected/654e707c-80ac-4c82-830c-0da1b878de2f-kube-api-access-45mpj\") pod \"payload-pre-processing-579785bc64-lgqmb\" (UID: \"654e707c-80ac-4c82-830c-0da1b878de2f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:11.170476 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.170406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mpj\" (UniqueName: \"kubernetes.io/projected/654e707c-80ac-4c82-830c-0da1b878de2f-kube-api-access-45mpj\") pod \"payload-pre-processing-579785bc64-lgqmb\" (UID: \"654e707c-80ac-4c82-830c-0da1b878de2f\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:11.273277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.273236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:11.413164 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.413135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgqmb"] Jun 13 01:09:11.418219 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:09:11.417812 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654e707c_80ac_4c82_830c_0da1b878de2f.slice/crio-57ec5a8de23fe11af2121ef69ef2b779fd91b2255d1c6f89fa4595ef36d19df8 WatchSource:0}: Error finding container 57ec5a8de23fe11af2121ef69ef2b779fd91b2255d1c6f89fa4595ef36d19df8: Status 404 returned error can't find the container with id 57ec5a8de23fe11af2121ef69ef2b779fd91b2255d1c6f89fa4595ef36d19df8 Jun 13 01:09:11.459556 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:11.458812 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" event={"ID":"654e707c-80ac-4c82-830c-0da1b878de2f","Type":"ContainerStarted","Data":"57ec5a8de23fe11af2121ef69ef2b779fd91b2255d1c6f89fa4595ef36d19df8"} Jun 13 01:09:14.476581 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:14.476537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" event={"ID":"654e707c-80ac-4c82-830c-0da1b878de2f","Type":"ContainerStarted","Data":"48313ddfc8a488690a64be9d9594005ac64fdc6cd5f6963c5b734c6f109b9a89"} Jun 13 01:09:14.477017 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:14.476671 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:14.491432 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:14.491376 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" podStartSLOduration=1.936861544 podStartE2EDuration="4.491360678s" totalImagesPullingTime="2.554499134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:09:14.490318047 +0000 UTC m=+828.001733880" watchObservedRunningTime="2026-06-13 01:09:14.491360678 +0000 UTC m=+828.002776486" Jun 13 01:09:19.508068 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.508030 2558 generic.go:356] "Generic (PLEG): container finished" podID="b9aee6cd-9a74-40d3-a0dc-0f7a3426e240" containerID="6e3b6d87226d52af982d2deb297e9a951673a8f999c165080b2aca604fdfefca" exitCode=0 Jun 13 01:09:19.508068 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.508051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" event={"ID":"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240","Type":"ContainerDied","Data":"6e3b6d87226d52af982d2deb297e9a951673a8f999c165080b2aca604fdfefca"} Jun 13 01:09:19.508695 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.508539 2558 scope.go:117] "RemoveContainer" containerID="6e3b6d87226d52af982d2deb297e9a951673a8f999c165080b2aca604fdfefca" Jun 13 01:09:19.509614 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.509588 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:09:19.509698 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.509652 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:09:19.509698 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.509687 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:09:19.677540 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:19.677506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:09:20.518342 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:20.518308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" event={"ID":"b9aee6cd-9a74-40d3-a0dc-0f7a3426e240","Type":"ContainerStarted","Data":"e62f1e94ef93e25c08f5611caa7e180939cd240a24c65a1f7def1379274ec4e1"} Jun 13 01:09:21.074813 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:21.074773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:09:21.075968 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:21.075943 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m42pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 13 01:09:21.076092 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:21.075994 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" podUID="b9aee6cd-9a74-40d3-a0dc-0f7a3426e240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 13 01:09:21.973939 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:21.973890 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:21.974522 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:21.974185 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" containerID="cri-o://7bd728e0e0f7bc7fc3e9af3bbb4ef99ade1a9fd3ed03e1707f6e8450c90f785a" gracePeriod=30 Jun 13 01:09:22.075425 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:22.075389 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m42pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 13 01:09:22.075620 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:22.075450 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" podUID="b9aee6cd-9a74-40d3-a0dc-0f7a3426e240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 13 01:09:23.074953 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.074917 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m42pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 13 01:09:23.075378 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.074978 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" podUID="b9aee6cd-9a74-40d3-a0dc-0f7a3426e240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 13 01:09:23.543325 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.543281 2558 generic.go:356] "Generic (PLEG): container finished" podID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerID="7bd728e0e0f7bc7fc3e9af3bbb4ef99ade1a9fd3ed03e1707f6e8450c90f785a" exitCode=143 Jun 13 01:09:23.543509 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.543348 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"81596e1f-1379-43df-abbe-bdcb7e7efc58","Type":"ContainerDied","Data":"7bd728e0e0f7bc7fc3e9af3bbb4ef99ade1a9fd3ed03e1707f6e8450c90f785a"} Jun 13 01:09:23.676052 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.676024 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:23.781129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.781103 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwmdw\" (UniqueName: \"kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw\") pod \"81596e1f-1379-43df-abbe-bdcb7e7efc58\" (UID: \"81596e1f-1379-43df-abbe-bdcb7e7efc58\") " Jun 13 01:09:23.783277 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.783249 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw" (OuterVolumeSpecName: "kube-api-access-xwmdw") pod "81596e1f-1379-43df-abbe-bdcb7e7efc58" (UID: "81596e1f-1379-43df-abbe-bdcb7e7efc58"). InnerVolumeSpecName "kube-api-access-xwmdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:09:23.882723 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:23.882681 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwmdw\" (UniqueName: \"kubernetes.io/projected/81596e1f-1379-43df-abbe-bdcb7e7efc58-kube-api-access-xwmdw\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:09:24.075554 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.075461 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m42pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 13 01:09:24.075554 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.075515 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" podUID="b9aee6cd-9a74-40d3-a0dc-0f7a3426e240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 13 01:09:24.550643 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.550615 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.550643 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.550635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"81596e1f-1379-43df-abbe-bdcb7e7efc58","Type":"ContainerDied","Data":"0efc5f70dc5d5c552a353a1930683c6c70767bb5416554cc75e9dc9fa2409578"} Jun 13 01:09:24.550931 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.550698 2558 scope.go:117] "RemoveContainer" containerID="7bd728e0e0f7bc7fc3e9af3bbb4ef99ade1a9fd3ed03e1707f6e8450c90f785a" Jun 13 01:09:24.572915 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.572887 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:24.574578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.574556 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:24.593925 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.593899 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:24.594287 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.594274 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" Jun 13 01:09:24.594334 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.594288 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" Jun 13 01:09:24.594370 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.594354 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" containerName="keycloak" Jun 13 01:09:24.599322 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.599305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.601429 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.601409 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w8f5f\"" Jun 13 01:09:24.601525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.601430 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 01:09:24.601525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.601448 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:09:24.601525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.601459 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:09:24.601525 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.601453 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:09:24.605150 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.605129 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:24.690602 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.690562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l9fz\" (UniqueName: \"kubernetes.io/projected/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-kube-api-access-2l9fz\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.690828 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.690675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-test-realms\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.791230 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.791162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l9fz\" (UniqueName: \"kubernetes.io/projected/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-kube-api-access-2l9fz\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.791417 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.791267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-test-realms\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.792003 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.791981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-test-realms\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.802152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.802088 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l9fz\" (UniqueName: \"kubernetes.io/projected/7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc-kube-api-access-2l9fz\") pod \"maas-keycloak-0\" (UID: \"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:24.889183 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.889141 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81596e1f-1379-43df-abbe-bdcb7e7efc58" path="/var/lib/kubelet/pods/81596e1f-1379-43df-abbe-bdcb7e7efc58/volumes" Jun 13 01:09:24.911429 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:24.911398 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:25.046005 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.045978 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:09:25.048241 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:09:25.048210 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa9f20a_fd7a_48f5_87f1_796e09ff0ddc.slice/crio-534094cfedc56f939b3bf5c2ecf5a4e8f90d1911774f7925060f72d02a0bc79b WatchSource:0}: Error finding container 534094cfedc56f939b3bf5c2ecf5a4e8f90d1911774f7925060f72d02a0bc79b: Status 404 returned error can't find the container with id 534094cfedc56f939b3bf5c2ecf5a4e8f90d1911774f7925060f72d02a0bc79b Jun 13 01:09:25.078260 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.078205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:09:25.078580 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.078472 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:09:25.079276 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.079259 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m42pv" Jun 13 01:09:25.483315 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.483286 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" podUID="654e707c-80ac-4c82-830c-0da1b878de2f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.46:9004: connect: connection refused" Jun 13 01:09:25.558363 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.558327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc","Type":"ContainerStarted","Data":"e3777c34a5b392436da2e0cafb5138b3a1b2f8e1c4ae1ea3c205c2aae3acd274"} Jun 13 01:09:25.558548 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.558385 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc","Type":"ContainerStarted","Data":"534094cfedc56f939b3bf5c2ecf5a4e8f90d1911774f7925060f72d02a0bc79b"} Jun 13 01:09:25.575823 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.575761 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.20665533 podStartE2EDuration="1.575744232s" totalImagesPullingTime="369.088902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:09:25.574077186 +0000 UTC m=+839.085493047" watchObservedRunningTime="2026-06-13 01:09:25.575744232 +0000 UTC m=+839.087160041" Jun 13 01:09:25.912249 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.912206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:25.913845 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:25.913819 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:26.912323 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:26.912271 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:27.912894 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:27.912842 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:28.912484 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:28.912418 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:29.913152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:29.912682 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:30.912710 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:30.912660 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:31.912187 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:31.912121 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:32.916960 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:32.916834 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:33.912317 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:33.912265 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:34.912355 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:34.912315 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:34.912799 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:34.912576 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:35.482494 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:35.482461 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-lgqmb" Jun 13 01:09:35.912313 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:35.912256 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:36.912528 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:36.912489 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:37.912131 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:37.912084 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.47:9000/health/started\": dial tcp 10.132.0.47:9000: connect: connection refused" Jun 13 01:09:39.024469 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:39.024044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:39.047240 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:39.043950 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:09:49.030366 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:49.030311 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7aa9f20a-fd7a-48f5-87f1-796e09ff0ddc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:09:59.030781 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:09:59.030730 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:10:09.723002 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.722923 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7696f587dc-z6wvd"] Jun 13 01:10:09.726942 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.726922 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.728898 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.728880 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 01:10:09.733484 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.733465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7696f587dc-z6wvd"] Jun 13 01:10:09.834875 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.834840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/adc5d8e8-b094-4a83-bdf0-94444eadf38f-oidc-ca\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.835014 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.834879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgn78\" (UniqueName: \"kubernetes.io/projected/adc5d8e8-b094-4a83-bdf0-94444eadf38f-kube-api-access-mgn78\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.835014 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.834944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adc5d8e8-b094-4a83-bdf0-94444eadf38f-tls-cert\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.935930 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.935895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adc5d8e8-b094-4a83-bdf0-94444eadf38f-tls-cert\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.936095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.936002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/adc5d8e8-b094-4a83-bdf0-94444eadf38f-oidc-ca\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.936095 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.936030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgn78\" (UniqueName: \"kubernetes.io/projected/adc5d8e8-b094-4a83-bdf0-94444eadf38f-kube-api-access-mgn78\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.936691 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.936666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/adc5d8e8-b094-4a83-bdf0-94444eadf38f-oidc-ca\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.938435 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.938407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adc5d8e8-b094-4a83-bdf0-94444eadf38f-tls-cert\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:09.943110 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:09.943090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgn78\" (UniqueName: \"kubernetes.io/projected/adc5d8e8-b094-4a83-bdf0-94444eadf38f-kube-api-access-mgn78\") pod \"authorino-7696f587dc-z6wvd\" (UID: \"adc5d8e8-b094-4a83-bdf0-94444eadf38f\") " pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:10.060635 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.060599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696f587dc-z6wvd" Jun 13 01:10:10.194953 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.194830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7696f587dc-z6wvd"] Jun 13 01:10:10.197743 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:10:10.197712 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadc5d8e8_b094_4a83_bdf0_94444eadf38f.slice/crio-12dafe91138d9f12a35692f2a42f30e46fb3664028a0adf6cbc27e7786392891 WatchSource:0}: Error finding container 12dafe91138d9f12a35692f2a42f30e46fb3664028a0adf6cbc27e7786392891: Status 404 returned error can't find the container with id 12dafe91138d9f12a35692f2a42f30e46fb3664028a0adf6cbc27e7786392891 Jun 13 01:10:10.830092 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.830059 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7696f587dc-z6wvd" event={"ID":"adc5d8e8-b094-4a83-bdf0-94444eadf38f","Type":"ContainerStarted","Data":"cb0722ea3883fa881289e7fdb0a81cbfd4c5e47b82dc43c90f06f653f6578fd4"} Jun 13 01:10:10.830562 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.830101 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7696f587dc-z6wvd" event={"ID":"adc5d8e8-b094-4a83-bdf0-94444eadf38f","Type":"ContainerStarted","Data":"12dafe91138d9f12a35692f2a42f30e46fb3664028a0adf6cbc27e7786392891"} Jun 13 01:10:10.845578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.845523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7696f587dc-z6wvd" podStartSLOduration=1.55730261 podStartE2EDuration="1.845507022s" totalImagesPullingTime="288.204412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:10:10.843089729 +0000 UTC m=+884.354505538" watchObservedRunningTime="2026-06-13 01:10:10.845507022 +0000 UTC m=+884.356922830" Jun 13 01:10:10.869108 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.869078 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:10:10.869321 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:10.869296 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" podUID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" containerName="authorino" containerID="cri-o://e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1" gracePeriod=30 Jun 13 01:10:11.124957 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.124930 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:10:11.247973 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.247937 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert\") pod \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " Jun 13 01:10:11.248156 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.248042 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whncr\" (UniqueName: \"kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr\") pod \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\" (UID: \"fd5ec224-8f3d-48cc-86db-24fa2c92e204\") " Jun 13 01:10:11.250365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.250334 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr" (OuterVolumeSpecName: "kube-api-access-whncr") pod "fd5ec224-8f3d-48cc-86db-24fa2c92e204" (UID: "fd5ec224-8f3d-48cc-86db-24fa2c92e204"). InnerVolumeSpecName "kube-api-access-whncr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:10:11.258733 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.258708 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd5ec224-8f3d-48cc-86db-24fa2c92e204" (UID: "fd5ec224-8f3d-48cc-86db-24fa2c92e204"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:10:11.349660 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.349624 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd5ec224-8f3d-48cc-86db-24fa2c92e204-tls-cert\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:10:11.349660 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.349651 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whncr\" (UniqueName: \"kubernetes.io/projected/fd5ec224-8f3d-48cc-86db-24fa2c92e204-kube-api-access-whncr\") on node \"ip-10-0-140-23.ec2.internal\" DevicePath \"\"" Jun 13 01:10:11.479294 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.479209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:11.582421 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.582387 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:11.836375 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.836341 2558 generic.go:356] "Generic (PLEG): container finished" podID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" containerID="e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1" exitCode=0 Jun 13 01:10:11.836789 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.836388 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" Jun 13 01:10:11.836789 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.836432 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" event={"ID":"fd5ec224-8f3d-48cc-86db-24fa2c92e204","Type":"ContainerDied","Data":"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1"} Jun 13 01:10:11.836789 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.836480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c8fdc795-v6kbq" event={"ID":"fd5ec224-8f3d-48cc-86db-24fa2c92e204","Type":"ContainerDied","Data":"c04c7dd35c78bf03a4d55286bf460f0accaa14d9a3e422b377f26454ef5e2115"} Jun 13 01:10:11.836789 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.836507 2558 scope.go:117] "RemoveContainer" containerID="e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1" Jun 13 01:10:11.846019 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.845999 2558 scope.go:117] "RemoveContainer" containerID="e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1" Jun 13 01:10:11.846359 ip-10-0-140-23 kubenswrapper[2558]: E0613 01:10:11.846341 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1\": container with ID starting with e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1 not found: ID does not exist" containerID="e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1" Jun 13 01:10:11.846418 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.846367 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1"} err="failed to get container status \"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1\": rpc error: code = NotFound desc = could not find container \"e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1\": container with ID starting with e5418333252fbf1f9b58d2560039a3281f2afdf3682ff2c11ad96e74d84809e1 not found: ID does not exist" Jun 13 01:10:11.860849 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.860809 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:10:11.864557 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:11.864524 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c8fdc795-v6kbq"] Jun 13 01:10:12.891632 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:12.891597 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" path="/var/lib/kubelet/pods/fd5ec224-8f3d-48cc-86db-24fa2c92e204/volumes" Jun 13 01:10:26.900965 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:26.900932 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:10:26.903070 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:26.903048 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:10:26.906860 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:26.906839 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:10:26.908420 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:26.908402 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:10:31.206756 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.206724 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5"] Jun 13 01:10:31.207126 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.207095 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" containerName="authorino" Jun 13 01:10:31.207126 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.207107 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" containerName="authorino" Jun 13 01:10:31.207236 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.207208 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5ec224-8f3d-48cc-86db-24fa2c92e204" containerName="authorino" Jun 13 01:10:31.211695 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.211673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.215818 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.215792 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 01:10:31.216263 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.216229 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwj4v\"" Jun 13 01:10:31.216263 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.216247 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 01:10:31.216430 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.216256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 13 01:10:31.221911 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.221889 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5"] Jun 13 01:10:31.229304 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.229425 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.229425 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.229425 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cbae595-31af-48f3-aec7-47b17dd921ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.229622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4scdk\" (UniqueName: \"kubernetes.io/projected/3cbae595-31af-48f3-aec7-47b17dd921ed-kube-api-access-4scdk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.229622 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.229473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.245633 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.245608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:31.330568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.330785 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.330785 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.330785 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.330785 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cbae595-31af-48f3-aec7-47b17dd921ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.330785 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.330777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4scdk\" (UniqueName: \"kubernetes.io/projected/3cbae595-31af-48f3-aec7-47b17dd921ed-kube-api-access-4scdk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.331103 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.331074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.331162 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.331101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.331218 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.331189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.332968 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.332949 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cbae595-31af-48f3-aec7-47b17dd921ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.333088 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.333071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cbae595-31af-48f3-aec7-47b17dd921ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.338067 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.338043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4scdk\" (UniqueName: \"kubernetes.io/projected/3cbae595-31af-48f3-aec7-47b17dd921ed-kube-api-access-4scdk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5\" (UID: \"3cbae595-31af-48f3-aec7-47b17dd921ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.523556 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.523447 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" Jun 13 01:10:31.682606 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.682573 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5"] Jun 13 01:10:31.684274 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:10:31.684240 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbae595_31af_48f3_aec7_47b17dd921ed.slice/crio-dee16ede1be65db2870182ac4f4e953a9ac4a8c71f518b9843eb292089ba5cd4 WatchSource:0}: Error finding container dee16ede1be65db2870182ac4f4e953a9ac4a8c71f518b9843eb292089ba5cd4: Status 404 returned error can't find the container with id dee16ede1be65db2870182ac4f4e953a9ac4a8c71f518b9843eb292089ba5cd4 Jun 13 01:10:31.949917 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:31.949881 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" event={"ID":"3cbae595-31af-48f3-aec7-47b17dd921ed","Type":"ContainerStarted","Data":"dee16ede1be65db2870182ac4f4e953a9ac4a8c71f518b9843eb292089ba5cd4"} Jun 13 01:10:35.972991 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:35.972953 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5" event={"ID":"3cbae595-31af-48f3-aec7-47b17dd921ed","Type":"ContainerStarted","Data":"1b32bb08de70b6ebf447af9bd6238cf118d129264a46a0f8692745dd3f7bfa3d"} Jun 13 01:10:45.426921 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:45.426880 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:47.697549 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:47.697508 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:51.367486 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:10:51.367420 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:00.257867 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:00.257816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:02.918280 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:02.918247 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8"] Jun 13 01:11:02.921888 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:02.921860 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:02.924098 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:02.924070 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 13 01:11:02.934568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:02.934539 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8"] Jun 13 01:11:02.966696 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:02.966666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:03.024905 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.024878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpkf2\" (UniqueName: \"kubernetes.io/projected/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kube-api-access-lpkf2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.025129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.024922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.025129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.024953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.025129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.025009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.025129 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.025036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.025323 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.025144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126358 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126327 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126406 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpkf2\" (UniqueName: \"kubernetes.io/projected/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kube-api-access-lpkf2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126568 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126870 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126749 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126870 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126831 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.126965 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.126921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.128848 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.128826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.129017 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.129000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.138209 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.138187 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpkf2\" (UniqueName: \"kubernetes.io/projected/88571b4d-f9aa-4a10-a59b-e37393fa6ab2-kube-api-access-lpkf2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8\" (UID: \"88571b4d-f9aa-4a10-a59b-e37393fa6ab2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.233763 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.233682 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:11:03.384851 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:03.384811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8"] Jun 13 01:11:03.390696 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:11:03.390649 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88571b4d_f9aa_4a10_a59b_e37393fa6ab2.slice/crio-e15a06ad822fefbc47bbdaed6809f0e82ae114371ac54ab15d44ce00b7d492b0 WatchSource:0}: Error finding container e15a06ad822fefbc47bbdaed6809f0e82ae114371ac54ab15d44ce00b7d492b0: Status 404 returned error can't find the container with id e15a06ad822fefbc47bbdaed6809f0e82ae114371ac54ab15d44ce00b7d492b0 Jun 13 01:11:04.116264 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:04.116219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" event={"ID":"88571b4d-f9aa-4a10-a59b-e37393fa6ab2","Type":"ContainerStarted","Data":"7af075ae21fc1635288a1c38236e3088d63b4d401e3982ad9611e3b051aeef67"} Jun 13 01:11:04.116668 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:04.116285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" event={"ID":"88571b4d-f9aa-4a10-a59b-e37393fa6ab2","Type":"ContainerStarted","Data":"e15a06ad822fefbc47bbdaed6809f0e82ae114371ac54ab15d44ce00b7d492b0"} Jun 13 01:11:31.217551 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:31.217510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:34.166832 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:34.166792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:34.226463 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:34.226432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:38.439580 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.439537 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg"] Jun 13 01:11:38.443711 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.443689 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.445881 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.445860 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 13 01:11:38.453930 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.453901 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg"] Jun 13 01:11:38.477116 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.477085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:38.555152 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.555365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.555365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fct6r\" (UniqueName: \"kubernetes.io/projected/ab67390e-bb8e-4362-9510-2512ed07f512-kube-api-access-fct6r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.555365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.555365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab67390e-bb8e-4362-9510-2512ed07f512-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.555365 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.555339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656398 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct6r\" (UniqueName: \"kubernetes.io/projected/ab67390e-bb8e-4362-9510-2512ed07f512-kube-api-access-fct6r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab67390e-bb8e-4362-9510-2512ed07f512-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656578 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656864 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656864 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.656989 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.656947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.658833 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.658805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab67390e-bb8e-4362-9510-2512ed07f512-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.659094 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.659076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab67390e-bb8e-4362-9510-2512ed07f512-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.664542 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.664508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct6r\" (UniqueName: \"kubernetes.io/projected/ab67390e-bb8e-4362-9510-2512ed07f512-kube-api-access-fct6r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-98ggg\" (UID: \"ab67390e-bb8e-4362-9510-2512ed07f512\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.754209 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.754106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:11:38.891159 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:38.891135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg"] Jun 13 01:11:38.893200 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:11:38.893138 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab67390e_bb8e_4362_9510_2512ed07f512.slice/crio-8c4e6fca13a1a9a0eb4cc5d9239cf8f00c96584b5aa57e1f646051303dcf3c05 WatchSource:0}: Error finding container 8c4e6fca13a1a9a0eb4cc5d9239cf8f00c96584b5aa57e1f646051303dcf3c05: Status 404 returned error can't find the container with id 8c4e6fca13a1a9a0eb4cc5d9239cf8f00c96584b5aa57e1f646051303dcf3c05 Jun 13 01:11:39.297689 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:39.297650 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" event={"ID":"ab67390e-bb8e-4362-9510-2512ed07f512","Type":"ContainerStarted","Data":"201605591c45802cb72555f9869b5404e451008a1137c4ae6a78eae72e382b8d"} Jun 13 01:11:39.297908 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:39.297709 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" event={"ID":"ab67390e-bb8e-4362-9510-2512ed07f512","Type":"ContainerStarted","Data":"8c4e6fca13a1a9a0eb4cc5d9239cf8f00c96584b5aa57e1f646051303dcf3c05"} Jun 13 01:11:49.429023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:49.428979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:57.396164 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:57.396132 2558 generic.go:356] "Generic (PLEG): container finished" podID="88571b4d-f9aa-4a10-a59b-e37393fa6ab2" containerID="7af075ae21fc1635288a1c38236e3088d63b4d401e3982ad9611e3b051aeef67" exitCode=0 Jun 13 01:11:57.396660 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:57.396211 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" event={"ID":"88571b4d-f9aa-4a10-a59b-e37393fa6ab2","Type":"ContainerDied","Data":"7af075ae21fc1635288a1c38236e3088d63b4d401e3982ad9611e3b051aeef67"} Jun 13 01:11:57.396964 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:57.396944 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:11:59.407809 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:59.407774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" event={"ID":"88571b4d-f9aa-4a10-a59b-e37393fa6ab2","Type":"ContainerStarted","Data":"d5ef9d505078ae9aedee4dda5cb40c2c44050c58f18fe711664f767318f00de8"} Jun 13 01:11:59.428926 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:11:59.428868 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" podStartSLOduration=3.261276749 podStartE2EDuration="57.428850702s" totalImagesPullingTime="998.681741ms" totalInitContainerRuntime="53.168892212s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:59.426746242 +0000 UTC m=+992.938162052" watchObservedRunningTime="2026-06-13 01:11:59.428850702 +0000 UTC m=+992.940266518" Jun 13 01:12:03.234210 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:12:03.234155 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:12:03.234958 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:12:03.234246 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:12:03.247364 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:12:03.247339 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:12:03.439419 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:12:03.439391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8" Jun 13 01:13:23.845638 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:23.845604 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab67390e-bb8e-4362-9510-2512ed07f512" containerID="201605591c45802cb72555f9869b5404e451008a1137c4ae6a78eae72e382b8d" exitCode=0 Jun 13 01:13:23.846094 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:23.845678 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" event={"ID":"ab67390e-bb8e-4362-9510-2512ed07f512","Type":"ContainerDied","Data":"201605591c45802cb72555f9869b5404e451008a1137c4ae6a78eae72e382b8d"} Jun 13 01:13:24.853976 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:24.853935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" event={"ID":"ab67390e-bb8e-4362-9510-2512ed07f512","Type":"ContainerStarted","Data":"14afa1109adb15c0fdee514264aa9e580f6b226c90715dd560007e9e19fe5570"} Jun 13 01:13:24.874811 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:24.874754 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" podStartSLOduration=2.118133078 podStartE2EDuration="1m46.874737987s" totalImagesPullingTime="178.938983ms" totalInitContainerRuntime="1m44.577665926s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:13:24.873469307 +0000 UTC m=+1078.384885135" watchObservedRunningTime="2026-06-13 01:13:24.874737987 +0000 UTC m=+1078.386153797" Jun 13 01:13:28.754551 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:28.754511 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:13:28.754956 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:28.754583 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:13:28.766807 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:28.766773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:13:28.888980 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:13:28.888956 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-98ggg" Jun 13 01:14:43.616953 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:14:43.616869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.677608 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:14:43.677575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:26.931645 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:15:26.931615 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:15:26.934518 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:15:26.934493 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:15:26.937451 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:15:26.937432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:15:26.940197 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:15:26.940161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgfdp_6b4233ce-f28c-4572-b8d0-69713ddcb132/ovn-acl-logging/0.log" Jun 13 01:18:31.345447 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:31.345416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7696f587dc-z6wvd_adc5d8e8-b094-4a83-bdf0-94444eadf38f/authorino/0.log" Jun 13 01:18:35.801286 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:35.801258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69865545cf-ml7zj_96543c82-428a-40fb-b93e-4a7bd9dfbba2/nginx/0.log" Jun 13 01:18:36.612593 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:36.612561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zllwk_a4087d00-aa88-42f9-8484-279dd645732c/server/0.log" Jun 13 01:18:36.845547 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:36.845520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f5d9f6fb-glqzt_a2ed33f7-0568-4c75-907a-77356835cc1c/copy-manifests/0.log" Jun 13 01:18:36.852812 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:36.852784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f5d9f6fb-glqzt_a2ed33f7-0568-4c75-907a-77356835cc1c/manager/0.log" Jun 13 01:18:38.473074 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:38.473036 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7696f587dc-z6wvd_adc5d8e8-b094-4a83-bdf0-94444eadf38f/authorino/0.log" Jun 13 01:18:38.585867 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:38.585840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kl794_11633cc6-e2b8-4fa3-b201-5e1dca1ecb86/manager/0.log" Jun 13 01:18:38.920245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:38.920218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w8fjk_ca65a7ea-9dc7-44b2-a4ff-49767f80b234/registry-server/0.log" Jun 13 01:18:39.041415 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:39.041389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gm2x7_7c6485e7-c586-4e1e-90a8-661b40a32cdf/manager/0.log" Jun 13 01:18:39.595084 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:39.595057 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795khm22_5b2d258d-e3ba-49e0-ab63-25a4b134e836/istio-proxy/0.log" Jun 13 01:18:40.033344 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.033315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/1.log" Jun 13 01:18:40.143919 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.143883 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgqmb_654e707c-80ac-4c82-830c-0da1b878de2f/payload-pre-processing/0.log" Jun 13 01:18:40.358504 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.358421 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647b4987fd-8bpv2_5a5ca467-4268-4c15-b554-8655e2cd58cb/router/0.log" Jun 13 01:18:40.688737 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.688662 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2n2q5_3cbae595-31af-48f3-aec7-47b17dd921ed/storage-initializer/0.log" Jun 13 01:18:40.924767 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.924737 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8_88571b4d-f9aa-4a10-a59b-e37393fa6ab2/storage-initializer/0.log" Jun 13 01:18:40.931542 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:40.931522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-h4sl8_88571b4d-f9aa-4a10-a59b-e37393fa6ab2/main/0.log" Jun 13 01:18:41.158041 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:41.158009 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-98ggg_ab67390e-bb8e-4362-9510-2512ed07f512/storage-initializer/0.log" Jun 13 01:18:41.164740 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:41.164718 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-98ggg_ab67390e-bb8e-4362-9510-2512ed07f512/main/0.log" Jun 13 01:18:45.340302 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:45.340267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:46.378838 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:46.378800 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:48.243351 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:48.243322 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvstp_c6eaa436-6a21-4837-a427-6cbdaae027c7/global-pull-secret-syncer/0.log" Jun 13 01:18:48.328024 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:48.327989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" Jun 13 01:18:48.463155 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:48.463120 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-23.ec2.internal_f341c26788f7c8a897d12eca4dbc7e0d/haproxy/0.log" Jun 13 01:18:54.041390 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:54.041356 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7696f587dc-z6wvd_adc5d8e8-b094-4a83-bdf0-94444eadf38f/authorino/0.log" Jun 13 01:18:54.074949 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:54.074917 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kl794_11633cc6-e2b8-4fa3-b201-5e1dca1ecb86/manager/0.log" Jun 13 01:18:54.172014 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:54.171981 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w8fjk_ca65a7ea-9dc7-44b2-a4ff-49767f80b234/registry-server/0.log" Jun 13 01:18:54.208354 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:54.208329 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gm2x7_7c6485e7-c586-4e1e-90a8-661b40a32cdf/manager/0.log" Jun 13 01:18:56.182023 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.181993 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pl9p8_e312af95-5df1-40aa-99f2-d2cb3a3ed787/kube-state-metrics/0.log" Jun 13 01:18:56.212862 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.212833 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pl9p8_e312af95-5df1-40aa-99f2-d2cb3a3ed787/kube-rbac-proxy-main/0.log" Jun 13 01:18:56.235274 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.235247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pl9p8_e312af95-5df1-40aa-99f2-d2cb3a3ed787/kube-rbac-proxy-self/0.log" Jun 13 01:18:56.307624 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.307596 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-v2w7b_bd6620ef-b543-44f5-8d79-22b5cd67e798/monitoring-plugin/0.log" Jun 13 01:18:56.464971 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.464889 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srlz7_1773c825-d520-4478-92e4-32ee3ff1445a/node-exporter/0.log" Jun 13 01:18:56.492679 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.492654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srlz7_1773c825-d520-4478-92e4-32ee3ff1445a/kube-rbac-proxy/0.log" Jun 13 01:18:56.520257 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.520234 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srlz7_1773c825-d520-4478-92e4-32ee3ff1445a/init-textfile/0.log" Jun 13 01:18:56.962938 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.962891 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qcv76_f9ea694f-f38b-431d-9801-73798e4f72db/prometheus-operator/0.log" Jun 13 01:18:56.982857 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:56.982823 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-qcv76_f9ea694f-f38b-431d-9801-73798e4f72db/kube-rbac-proxy/0.log" Jun 13 01:18:57.011051 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:57.011035 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-5l2vd_5112c9d6-d2f7-4179-b7ca-d762474e75b3/prometheus-operator-admission-webhook/0.log" Jun 13 01:18:58.824937 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:58.824904 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-m5g5w_3594a1fd-797f-4f32-acc1-c3535334a444/networking-console-plugin/0.log" Jun 13 01:18:59.491207 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:59.491161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/1.log" Jun 13 01:18:59.496134 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:18:59.496113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-zl5rr_fc9b2b19-72ce-4da3-96ba-90853666be05/console-operator/2.log" Jun 13 01:19:00.167306 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.167272 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn"] Jun 13 01:19:00.170998 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.170979 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.172866 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.172849 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gstxc\"/\"default-dockercfg-jkl7d\"" Jun 13 01:19:00.172943 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.172880 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gstxc\"/\"openshift-service-ca.crt\"" Jun 13 01:19:00.173590 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.173576 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gstxc\"/\"kube-root-ca.crt\"" Jun 13 01:19:00.178415 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.177958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn"] Jun 13 01:19:00.225823 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.225796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-sys\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.225943 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.225826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-podres\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.225943 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.225863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnsm\" (UniqueName: \"kubernetes.io/projected/618ed1be-656f-4157-a195-4e7819673e82-kube-api-access-2mnsm\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.225943 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.225930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-lib-modules\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.226051 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.225966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-proc\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327263 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnsm\" (UniqueName: \"kubernetes.io/projected/618ed1be-656f-4157-a195-4e7819673e82-kube-api-access-2mnsm\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327450 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-lib-modules\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327450 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-proc\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327450 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-sys\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327450 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-podres\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-lib-modules\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-proc\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-sys\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.327664 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.327532 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618ed1be-656f-4157-a195-4e7819673e82-podres\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.334245 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.334223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnsm\" (UniqueName: \"kubernetes.io/projected/618ed1be-656f-4157-a195-4e7819673e82-kube-api-access-2mnsm\") pod \"perf-node-gather-daemonset-rmxbn\" (UID: \"618ed1be-656f-4157-a195-4e7819673e82\") " pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.482780 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.482677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:00.615347 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.615317 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn"] Jun 13 01:19:00.618106 ip-10-0-140-23 kubenswrapper[2558]: W0613 01:19:00.618077 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod618ed1be_656f_4157_a195_4e7819673e82.slice/crio-167e82af4d050682b72b47e25076ad1ffa547bc2c440e924429caa0385e80772 WatchSource:0}: Error finding container 167e82af4d050682b72b47e25076ad1ffa547bc2c440e924429caa0385e80772: Status 404 returned error can't find the container with id 167e82af4d050682b72b47e25076ad1ffa547bc2c440e924429caa0385e80772 Jun 13 01:19:00.891788 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:00.891758 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-67bgh_6e30ec7d-b0da-4659-bc8c-ed49c7022075/volume-data-source-validator/0.log" Jun 13 01:19:01.566459 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:01.566424 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" event={"ID":"618ed1be-656f-4157-a195-4e7819673e82","Type":"ContainerStarted","Data":"b49f8cea81be7f6508b668822449f3f03fb4cbcdfd539a11e6d885ad20b1e1c6"} Jun 13 01:19:01.566909 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:01.566574 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:01.566909 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:01.566617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" event={"ID":"618ed1be-656f-4157-a195-4e7819673e82","Type":"ContainerStarted","Data":"167e82af4d050682b72b47e25076ad1ffa547bc2c440e924429caa0385e80772"} Jun 13 01:19:01.583960 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:01.583907 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" podStartSLOduration=1.583892471 podStartE2EDuration="1.583892471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:01.581353802 +0000 UTC m=+1415.092769610" watchObservedRunningTime="2026-06-13 01:19:01.583892471 +0000 UTC m=+1415.095308345" Jun 13 01:19:02.198344 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:02.198315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rw8dv_b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44/dns/0.log" Jun 13 01:19:02.221446 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:02.221419 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rw8dv_b88b81b6-ba3f-4f3d-81f4-7981b9cdfd44/kube-rbac-proxy/0.log" Jun 13 01:19:02.246020 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:02.245986 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpjtl_543185f8-be1e-40cb-9d02-77f63b0dfb0d/dns-node-resolver/0.log" Jun 13 01:19:02.939463 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:02.939436 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5m6t_6b0b1203-9b43-418d-baa0-29f565f17edb/node-ca/0.log" Jun 13 01:19:03.972202 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:03.972155 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795khm22_5b2d258d-e3ba-49e0-ab63-25a4b134e836/istio-proxy/0.log" Jun 13 01:19:04.103257 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:04.103228 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/1.log" Jun 13 01:19:04.103587 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:04.103567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/0.log" Jun 13 01:19:04.124628 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:04.124607 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgqmb_654e707c-80ac-4c82-830c-0da1b878de2f/payload-pre-processing/0.log" Jun 13 01:19:04.180357 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:04.180329 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647b4987fd-8bpv2_5a5ca467-4268-4c15-b554-8655e2cd58cb/router/0.log" Jun 13 01:19:04.840316 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:04.840285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-247nk_cee7da03-acd7-4363-8c7d-cdc00c3faa1c/serve-healthcheck-canary/0.log" Jun 13 01:19:05.445021 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:05.444992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-p7w9k_5b370a52-643d-472d-ba46-a8d5f74e398c/insights-operator/1.log" Jun 13 01:19:05.445485 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:05.445298 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-p7w9k_5b370a52-643d-472d-ba46-a8d5f74e398c/insights-operator/0.log" Jun 13 01:19:05.619080 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:05.619050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkrz6_c60aa0b8-83f3-46df-97b7-4a53293131a3/kube-rbac-proxy/0.log" Jun 13 01:19:05.642456 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:05.642428 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkrz6_c60aa0b8-83f3-46df-97b7-4a53293131a3/exporter/0.log" Jun 13 01:19:05.667535 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:05.667504 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkrz6_c60aa0b8-83f3-46df-97b7-4a53293131a3/extractor/0.log" Jun 13 01:19:07.582143 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:07.582116 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gstxc/perf-node-gather-daemonset-rmxbn" Jun 13 01:19:07.955894 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:07.955789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69865545cf-ml7zj_96543c82-428a-40fb-b93e-4a7bd9dfbba2/nginx/0.log" Jun 13 01:19:08.154598 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:08.154570 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zllwk_a4087d00-aa88-42f9-8484-279dd645732c/server/0.log" Jun 13 01:19:08.226662 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:08.226577 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f5d9f6fb-glqzt_a2ed33f7-0568-4c75-907a-77356835cc1c/manager/0.log" Jun 13 01:19:08.247868 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:08.247843 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f5d9f6fb-glqzt_a2ed33f7-0568-4c75-907a-77356835cc1c/copy-manifests/0.log" Jun 13 01:19:10.323250 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:10.323217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfh2n_32bb1370-fb10-465b-908c-21ccd5a74e23/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:10.325660 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:10.325637 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ccc6f94bf-lrgdz_e46f0758-60d4-4c66-a8d7-1fbf0bc654aa/manager/0.log" Jun 13 01:19:10.355823 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:10.355796 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rjtxk_b1de8339-b986-4f4a-88b7-84a6eaf89be2/openshift-lws-operator/0.log" Jun 13 01:19:16.389250 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.389219 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-jp48b_47c5a238-e76a-4415-a56e-551031ad3420/kube-storage-version-migrator-operator/1.log" Jun 13 01:19:16.389969 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.389947 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-jp48b_47c5a238-e76a-4415-a56e-551031ad3420/kube-storage-version-migrator-operator/0.log" Jun 13 01:19:16.569147 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.569118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795khm22_5b2d258d-e3ba-49e0-ab63-25a4b134e836/istio-proxy/0.log" Jun 13 01:19:16.655997 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.655915 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/1.log" Jun 13 01:19:16.656343 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.656325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/0.log" Jun 13 01:19:16.666867 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.666847 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgqmb_654e707c-80ac-4c82-830c-0da1b878de2f/payload-pre-processing/0.log" Jun 13 01:19:16.708063 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:16.708032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647b4987fd-8bpv2_5a5ca467-4268-4c15-b554-8655e2cd58cb/router/0.log" Jun 13 01:19:17.826599 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.826566 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/kube-multus-additional-cni-plugins/0.log" Jun 13 01:19:17.848252 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.848222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/egress-router-binary-copy/0.log" Jun 13 01:19:17.864122 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.864094 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795khm22_5b2d258d-e3ba-49e0-ab63-25a4b134e836/istio-proxy/0.log" Jun 13 01:19:17.868850 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.868834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/cni-plugins/0.log" Jun 13 01:19:17.892711 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.892693 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/bond-cni-plugin/0.log" Jun 13 01:19:17.914139 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.914118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/routeoverride-cni/0.log" Jun 13 01:19:17.934335 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.934315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/whereabouts-cni-bincopy/0.log" Jun 13 01:19:17.946244 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.946224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/1.log" Jun 13 01:19:17.946597 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.946583 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m42pv_b9aee6cd-9a74-40d3-a0dc-0f7a3426e240/istio-proxy/0.log" Jun 13 01:19:17.955118 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.955103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bnsf9_bc743a47-89bd-4fa6-b891-0e55dc7a0157/whereabouts-cni/0.log" Jun 13 01:19:17.969052 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:17.969032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgqmb_654e707c-80ac-4c82-830c-0da1b878de2f/payload-pre-processing/0.log" Jun 13 01:19:18.002648 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:18.002627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647b4987fd-8bpv2_5a5ca467-4268-4c15-b554-8655e2cd58cb/router/0.log" Jun 13 01:19:18.316776 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:18.316749 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wkmk2_e1ce7b52-3340-40ee-be19-69a7e5888de8/kube-multus/0.log" Jun 13 01:19:18.432560 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:18.432531 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrtvs_aac28d23-ca23-4c9b-ae46-c91e02fb5d27/network-metrics-daemon/0.log" Jun 13 01:19:18.452345 ip-10-0-140-23 kubenswrapper[2558]: I0613 01:19:18.452319 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrtvs_aac28d23-ca23-4c9b-ae46-c91e02fb5d27/kube-rbac-proxy/0.log"