Jun 08 12:01:47.793830 ip-10-0-132-69 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 12:01:47.793844 ip-10-0-132-69 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 12:01:47.793854 ip-10-0-132-69 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 12:01:47.794080 ip-10-0-132-69 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 12:01:57.906445 ip-10-0-132-69 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 12:01:57.906465 ip-10-0-132-69 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6feffd56ef3745658bc69b0e68be42f7 -- Jun 08 12:04:38.715408 ip-10-0-132-69 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:04:39.245623 ip-10-0-132-69 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.160613 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167127 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167138 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167142 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167147 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167152 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167156 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.258228 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167159 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167162 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167165 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167169 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167172 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167175 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167177 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167180 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167188 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167191 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167194 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167197 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167200 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167202 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167205 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167207 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167211 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167222 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167226 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.259587 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167229 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167232 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167235 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167238 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167241 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167243 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167246 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167249 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167252 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167254 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167257 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167259 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167262 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167266 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167268 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167271 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167274 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167276 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167279 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167281 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.260672 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167284 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167286 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167289 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167291 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167294 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167296 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167299 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167301 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167303 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167306 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167308 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167311 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167314 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167317 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167319 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167324 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167326 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167330 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167332 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167335 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.261900 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167338 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167340 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167343 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167346 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167349 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167351 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167354 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167357 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167359 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167362 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167364 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167367 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167369 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167372 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167374 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167377 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167379 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167382 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167385 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167387 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.263009 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167390 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167392 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167395 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167398 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167400 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167403 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167406 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167409 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167411 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167414 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167416 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167419 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167422 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.167425 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168117 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168123 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168126 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168129 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168133 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168136 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.264156 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168138 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168141 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168144 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168146 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168149 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168151 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168154 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168157 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168159 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168162 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168164 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168167 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168169 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168172 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168175 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168177 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168181 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168184 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168187 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168189 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.265342 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168192 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168194 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168197 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168199 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168202 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168205 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168207 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168210 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168212 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168215 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168220 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168224 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168228 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168230 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168233 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168236 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168239 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168242 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168245 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.266295 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168248 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168251 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168253 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168256 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168258 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168261 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168263 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168266 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168268 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168272 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168275 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168280 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168283 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168286 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168288 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168291 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168293 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168296 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168298 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168302 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.267190 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168305 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168307 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168309 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168312 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168314 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168317 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168320 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168322 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168325 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168327 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168330 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168332 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168335 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168337 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168340 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168344 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168347 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168350 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168353 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168356 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.268085 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168358 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168361 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168364 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168367 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168370 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168372 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168375 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168377 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168380 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168382 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168385 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168387 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168390 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168392 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168736 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168741 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168745 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168748 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168756 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.269086 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168760 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168762 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168765 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168767 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168770 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168773 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168776 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168780 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168783 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168786 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168788 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168792 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168795 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168798 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168801 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168804 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168806 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168809 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168811 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168814 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.269999 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168816 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168819 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168822 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168825 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168829 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168832 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168835 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168838 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168841 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168844 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168847 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168849 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168858 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168861 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168864 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168867 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168869 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168872 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168875 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168877 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.271043 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168880 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168883 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168885 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168889 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168892 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168894 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168897 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168900 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168902 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168905 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168908 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168911 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168913 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168916 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168918 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168921 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168923 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168926 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168928 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168931 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.271961 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168933 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168936 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168938 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168941 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168945 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168953 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168957 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168959 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168962 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168965 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168968 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168970 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168973 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168975 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168978 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168984 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168987 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168989 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168992 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.272879 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168994 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.168997 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169000 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169002 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169005 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169007 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169009 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169012 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169014 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169017 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169019 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169022 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169024 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169027 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169032 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169094 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169122 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169140 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169145 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169149 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169152 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:04:39.273706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169156 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169160 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169163 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169166 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169169 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169173 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169176 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169180 2575 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169183 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169186 2575 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169189 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169192 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169198 2575 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169201 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169204 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169207 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169210 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169214 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169217 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169220 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169223 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169226 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169229 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169232 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:04:39.274659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169235 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169239 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169243 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169246 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169249 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169251 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169254 2575 flags.go:64] FLAG: --enable-server="true" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169258 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169262 2575 flags.go:64] FLAG: --event-burst="100" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169265 2575 flags.go:64] FLAG: --event-qps="50" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169269 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169271 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169274 2575 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169280 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169284 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169288 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169291 2575 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169294 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169297 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169299 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169302 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169305 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169308 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169310 2575 flags.go:64] FLAG: --feature-gates="" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169314 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:04:39.275646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169317 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169320 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169323 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169326 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169329 2575 flags.go:64] FLAG: --help="false" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169332 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169335 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169338 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169342 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169345 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169348 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169351 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169354 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169356 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169359 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169367 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169371 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169373 2575 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169376 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169379 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169382 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169384 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169388 2575 flags.go:64] FLAG: --lock-file="" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169391 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:04:39.276412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169394 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169397 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169402 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169405 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169408 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169411 2575 flags.go:64] FLAG: --logging-format="text" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169413 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169416 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169419 2575 flags.go:64] FLAG: --manifest-url="" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169422 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169426 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169429 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169433 2575 flags.go:64] FLAG: --max-pods="110" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169436 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169439 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169441 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169445 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169448 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169451 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169454 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169460 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169463 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169466 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:04:39.277019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169469 2575 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169480 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169485 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169487 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169490 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169493 2575 flags.go:64] FLAG: --port="10250" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169496 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169499 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ce17bc6e5f52519" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169503 2575 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169506 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169509 2575 flags.go:64] FLAG: --register-node="true" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169512 2575 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169515 2575 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169518 2575 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169520 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169523 2575 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169527 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169530 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169532 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169535 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169538 2575 flags.go:64] FLAG: --runonce="false" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169541 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169544 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169546 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169549 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:04:39.277714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169553 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169556 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169559 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169562 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169565 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169568 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169570 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169573 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169576 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169584 2575 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169587 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169592 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169595 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169597 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169603 2575 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169608 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169611 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169614 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169617 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169619 2575 flags.go:64] FLAG: --v="2" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169623 2575 flags.go:64] FLAG: --version="false" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169627 2575 flags.go:64] FLAG: --vmodule="" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169630 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.169633 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169747 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.278492 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169750 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169754 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169756 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169759 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169762 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169764 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169767 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169771 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169774 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169777 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169779 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169782 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169784 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169787 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169790 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169792 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169795 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169798 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169800 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169803 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.279246 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169806 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169808 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169812 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169815 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169818 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169820 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169823 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169825 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169828 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169831 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169833 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169836 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169839 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169841 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169844 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169847 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169849 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169852 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169854 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169859 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.279854 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169861 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169864 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169866 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169869 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169871 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169874 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169877 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169879 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169882 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169884 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169887 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169889 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169892 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169895 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169899 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169903 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169906 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169909 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169912 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.280439 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169914 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169917 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169920 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169922 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169925 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169927 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169930 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169932 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169935 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169937 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169940 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169943 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169946 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169949 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169951 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169954 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169957 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169959 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169962 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.281239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169964 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169967 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169969 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169972 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169974 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169977 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169980 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169982 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169986 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169988 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169992 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169996 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.169999 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170003 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170006 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170009 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170012 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170015 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170018 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.282059 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.170021 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.170959 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.177868 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.177881 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.178753 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.178760 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178820 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178825 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178828 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178832 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178835 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178838 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178841 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178844 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178847 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.282553 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178850 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178853 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178855 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178864 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178867 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178873 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178875 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178878 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178881 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178883 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178886 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178889 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178891 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178894 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178897 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178899 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178903 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178907 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178910 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178913 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.282934 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178915 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178918 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178921 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178923 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178926 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178928 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178931 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178933 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178936 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178938 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178941 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178943 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178946 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178949 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178952 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178954 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178967 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178971 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178974 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.283457 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178976 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178979 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178981 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178984 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178987 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178989 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178992 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178995 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178997 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.178999 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179002 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179005 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179008 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179012 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179014 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179017 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179020 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179023 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179025 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.283914 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179028 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179030 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179033 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179037 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179040 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179043 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179045 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179048 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179051 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179053 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179055 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179063 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179066 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179069 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179072 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179075 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179077 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179080 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179082 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.284429 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179085 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179087 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179090 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179092 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179095 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179098 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179114 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179122 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179125 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179127 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179130 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179132 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179135 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.179140 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179305 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:39.285290 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179311 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179314 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179316 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179319 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179321 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179324 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179326 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179329 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179331 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179334 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179342 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179345 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179347 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179350 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179353 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179355 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179358 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179360 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179363 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179366 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:39.285779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179368 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179371 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179374 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179376 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179380 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179383 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179385 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179387 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179390 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179392 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179395 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179398 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179400 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179403 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179405 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179409 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179413 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179415 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179418 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179421 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:39.286585 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179424 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179430 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179432 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179440 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179443 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179446 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179448 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179451 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179453 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179456 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179459 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179461 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179463 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179466 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179468 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179471 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179475 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179478 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179480 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179483 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:39.287476 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179485 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179488 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179490 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179499 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179501 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179504 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179506 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179509 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179512 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179514 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179517 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179519 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179521 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179525 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179528 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179530 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179538 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179542 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179546 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:39.288319 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179549 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179552 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179554 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179557 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179559 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179562 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179564 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179568 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179571 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179576 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179579 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179582 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179584 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179587 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179590 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179592 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179595 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179598 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:39.288857 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:39.179600 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.179605 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.179708 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.181877 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.183401 2575 server.go:1019] "Starting client certificate rotation" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.183500 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.184409 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.186559 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.195511 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.209081 2575 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.211312 2575 log.go:25] "Validated CRI v1 image API" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.212028 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:04:39.289393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.215457 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8097a7db-46f3-48b5-9dbb-fa2ea5efe930:/dev/nvme0n1p4 d1d4a79b-a60b-4291-b270-c3adebf1b1ff:/dev/nvme0n1p3] Jun 08 12:04:39.289719 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.215472 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.220333 2575 manager.go:216] Machine: {Timestamp:2026-06-08 12:04:39.219854534 +0000 UTC m=+0.379283341 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101891 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25bd34d04e8e367217c1ef7bd48c03 SystemUUID:ec25bd34-d04e-8e36-7217-c1ef7bd48c03 BootID:6feffd56-ef37-4565-8bc6-9b0e68be42f7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:a5:08:d8:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:a5:08:d8:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:42:7d:43:5a:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.220429 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.220513 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.223812 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.223840 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.224688 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.224699 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:04:39.289771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.224706 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.225711 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.226197 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.226894 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230077 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230203 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230229 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230239 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230256 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230266 2575 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230275 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230572 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.230592 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.232809 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.234835 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.234862 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236242 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236255 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236261 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236269 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236279 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236285 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236294 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236299 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236305 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236311 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236320 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.236325 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.237533 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.237542 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.240457 2575 server.go:1268] "Started kubelet" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.240548 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.240610 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.244994 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.245289 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.245494 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.245635 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.246615 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.247646 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:04:39.290235 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.251769 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.252696 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.252706 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.252826 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.252384 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-69.ec2.internal.18b7198ee96a5d40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-69.ec2.internal,UID:ip-10-0-132-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-69.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.24043296 +0000 UTC m=+0.399861767,LastTimestamp:2026-06-08 12:04:39.24043296 +0000 UTC m=+0.399861767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-69.ec2.internal,}" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.253465 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.253484 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.253490 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.253590 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.253602 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.257419 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.257606 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258178 2575 factory.go:55] Registering systemd factory Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258212 2575 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258398 2575 factory.go:153] Registering CRI-O factory Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258410 2575 factory.go:223] Registration of the crio container factory successfully Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258464 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258491 2575 factory.go:103] Registering Raw factory Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258505 2575 manager.go:1196] Started watching for new ooms in manager Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.258886 2575 manager.go:349] Starting recovery of all containers Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.269636 2575 manager.go:354] Recovery completed Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.275502 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277378 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277416 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277431 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277913 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277921 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277927 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.277946 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.278804 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.278831 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.278841 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.279293 2575 policy_none.go:49] "None policy: Start" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.279309 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:04:39.291963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.279323 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:04:39.293085 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.280433 2575 policy_none.go:47] "Start" Jun 08 12:04:39.293085 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.292296 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-69.ec2.internal.18b7198eeb9e6d6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-69.ec2.internal,UID:ip-10-0-132-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-69.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-69.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.277399402 +0000 UTC m=+0.436828208,LastTimestamp:2026-06-08 12:04:39.277399402 +0000 UTC m=+0.436828208,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-69.ec2.internal,}" Jun 08 12:04:39.300161 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.300145 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c9lxd" Jun 08 12:04:39.304291 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.304230 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-69.ec2.internal.18b7198eeb9ecb51 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-69.ec2.internal,UID:ip-10-0-132-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-69.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-69.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.277423441 +0000 UTC m=+0.436852248,LastTimestamp:2026-06-08 12:04:39.277423441 +0000 UTC m=+0.436852248,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-69.ec2.internal,}" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.311139 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c9lxd" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.316928 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-69.ec2.internal.18b7198eeb9f00d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-69.ec2.internal,UID:ip-10-0-132-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-69.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-69.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.27743714 +0000 UTC m=+0.436865945,LastTimestamp:2026-06-08 12:04:39.27743714 +0000 UTC m=+0.436865945,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-69.ec2.internal,}" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.319855 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.320998 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.321027 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.321042 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:04:39.324176 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.321131 2575 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 08 12:04:39.335023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335007 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:39.335173 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335158 2575 manager.go:337] "Starting Device Plugin manager" Jun 08 12:04:39.335251 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.335189 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:04:39.335251 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335201 2575 server.go:87] "Starting device plugin registration server" Jun 08 12:04:39.335443 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335428 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:04:39.335480 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335447 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:04:39.335623 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335607 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:04:39.335700 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335689 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:04:39.335764 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.335702 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:04:39.336115 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.336084 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:04:39.336201 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.336150 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.421471 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.421422 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal"] Jun 08 12:04:39.421543 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.421496 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.423135 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.423119 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.423208 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.423150 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.423208 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.423161 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.424917 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.424906 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.425057 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.425040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.425091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.425069 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.425592 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.425579 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.425655 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.425602 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.425655 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.425614 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.426187 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.426172 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.426257 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.426193 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.426257 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.426204 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.428165 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.428151 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.428213 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.428176 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.428808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.428790 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.428885 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.428818 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.428885 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.428832 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.436287 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.436274 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.436919 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.436904 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.436988 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.436934 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.436988 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.436945 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.436988 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.436961 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.449638 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.449621 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-69.ec2.internal\" not found" node="ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.453780 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.453764 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-69.ec2.internal\" not found" node="ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.453780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.453773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.453885 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.453803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.453885 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.453822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34104b1ff5ad84f1a4b34f9808ccb83e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-69.ec2.internal\" (UID: \"34104b1ff5ad84f1a4b34f9808ccb83e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.456825 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.456809 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.456897 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.456829 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-69.ec2.internal\": node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.506059 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.506043 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.554522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34104b1ff5ad84f1a4b34f9808ccb83e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-69.ec2.internal\" (UID: \"34104b1ff5ad84f1a4b34f9808ccb83e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.554570 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.554570 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.554633 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34104b1ff5ad84f1a4b34f9808ccb83e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-69.ec2.internal\" (UID: \"34104b1ff5ad84f1a4b34f9808ccb83e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.554633 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.554633 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.554626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8d6a6bcb90b30930eb9f859bfb2eadf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal\" (UID: \"a8d6a6bcb90b30930eb9f859bfb2eadf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.607153 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.607131 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.707732 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.707695 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.754446 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.754425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.758597 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:39.758533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:39.808726 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.808593 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:39.909075 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:39.909052 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:40.009611 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.009562 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-69.ec2.internal\" not found" Jun 08 12:04:40.102222 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.102198 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:40.153815 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.153796 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" Jun 08 12:04:40.169574 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.169559 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:04:40.172132 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.172112 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" Jun 08 12:04:40.182181 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.182155 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:04:40.182255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.182241 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:04:40.182361 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.182342 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:04:40.182400 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.182381 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:04:40.230517 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.230500 2575 apiserver.go:52] "Watching apiserver" Jun 08 12:04:40.232167 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.232145 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d6a6bcb90b30930eb9f859bfb2eadf.slice/crio-8a02ffe347248f05d2f9257bd9c9a80cc79fca9d5f2ff8c3889df65c4d2a933f WatchSource:0}: Error finding container 8a02ffe347248f05d2f9257bd9c9a80cc79fca9d5f2ff8c3889df65c4d2a933f: Status 404 returned error can't find the container with id 8a02ffe347248f05d2f9257bd9c9a80cc79fca9d5f2ff8c3889df65c4d2a933f Jun 08 12:04:40.232727 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.232708 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34104b1ff5ad84f1a4b34f9808ccb83e.slice/crio-b686b79326fb26427a32b2b1380f40cfd5e816adf9d2f348471913f20f469141 WatchSource:0}: Error finding container b686b79326fb26427a32b2b1380f40cfd5e816adf9d2f348471913f20f469141: Status 404 returned error can't find the container with id b686b79326fb26427a32b2b1380f40cfd5e816adf9d2f348471913f20f469141 Jun 08 12:04:40.238151 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.238130 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:04:40.246865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.246846 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:04:40.248836 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.248812 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-njjnk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal","openshift-multus/multus-xd9lp","openshift-network-diagnostics/network-check-target-57jf7","openshift-network-operator/iptables-alerter-scc56","openshift-ovn-kubernetes/ovnkube-node-ppj6q","kube-system/global-pull-secret-syncer-v7swr","kube-system/konnectivity-agent-sxhhm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn","openshift-dns/node-resolver-ktzqj","openshift-multus/multus-additional-cni-plugins-gghx8","openshift-multus/network-metrics-daemon-mjdl2","kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5nvwk"] Jun 08 12:04:40.250737 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.250714 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.250829 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.250782 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:40.251820 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.251806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.252866 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.252848 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:04:40.252866 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.252871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.254275 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.254250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:40.254371 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.254301 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:40.254791 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.254777 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.255579 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.255560 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.256594 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.256575 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:04:40.256780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.256756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.256876 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.256808 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:04:40.256876 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.256814 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:04:40.256876 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.256821 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wrqtd\"" Jun 08 12:04:40.257046 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.257031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.257923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.257906 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:04:40.258789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.258789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-os-release\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-bin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-k8s-cni-cncf-io\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.258990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-daemon-config\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-etc-kubernetes\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cnibin\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cnibin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-os-release\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-netns\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-kubelet\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259310 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-socket-dir-parent\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-multus\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4k2\" (UniqueName: \"kubernetes.io/projected/00ec031c-b852-4a3f-bb12-10ab1ec9059e-kube-api-access-4v4k2\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-hostroot\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-multus-certs\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-dbus\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cni-binary-copy\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8r7\" (UniqueName: \"kubernetes.io/projected/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-kube-api-access-tl8r7\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-system-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-conf-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-system-cni-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.259895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.259583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-kubelet-config\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.260430 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.260415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.261601 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.261581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.263086 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.263071 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.264952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.264935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.265671 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.265650 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.265769 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.265705 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.265833 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.265795 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncnp2\"" Jun 08 12:04:40.266091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.266075 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.266183 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.266154 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:40.268436 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.268418 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:04:40.268523 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.268507 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:04:40.268629 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.268608 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7wjg4\"" Jun 08 12:04:40.268733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.268627 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.270446 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.270239 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:04:40.270694 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.270533 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.270694 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.270608 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:04:40.272588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.271402 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:04:40.272588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272237 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.272588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.272588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272354 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f7c8g\"" Jun 08 12:04:40.272588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272556 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.272917 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272613 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:04:40.272917 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.272666 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.273673 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.273656 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.274120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274072 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rg2xk\"" Jun 08 12:04:40.274120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274121 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:04:40.274120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274129 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5c59\"" Jun 08 12:04:40.274312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274080 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v8xkl\"" Jun 08 12:04:40.274312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274126 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:04:40.274312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274272 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:04:40.274312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274276 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.274540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274337 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:04:40.274540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx68b\"" Jun 08 12:04:40.274540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274471 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:04:40.274826 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.274813 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qh77g\"" Jun 08 12:04:40.282372 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.282353 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:04:40.309401 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.309384 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zxdhv" Jun 08 12:04:40.318757 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.318722 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 11:59:39 +0000 UTC" deadline="2027-11-20 02:53:01.577956589 +0000 UTC" Jun 08 12:04:40.318757 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.318755 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12710h48m21.259204078s" Jun 08 12:04:40.323497 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.323479 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zxdhv" Jun 08 12:04:40.323708 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.323668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" event={"ID":"a8d6a6bcb90b30930eb9f859bfb2eadf","Type":"ContainerStarted","Data":"8a02ffe347248f05d2f9257bd9c9a80cc79fca9d5f2ff8c3889df65c4d2a933f"} Jun 08 12:04:40.324717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.324698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" event={"ID":"34104b1ff5ad84f1a4b34f9808ccb83e","Type":"ContainerStarted","Data":"b686b79326fb26427a32b2b1380f40cfd5e816adf9d2f348471913f20f469141"} Jun 08 12:04:40.354898 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.354878 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:04:40.360008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.359992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-kubelet-config\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.360083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-host-slash\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.360083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-tuned\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.360083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-k8s-cni-cncf-io\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-daemon-config\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-k8s-cni-cncf-io\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360144 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-kubelet-config\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360255 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-etc-kubernetes\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360276 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-etc-kubernetes\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4wb\" (UniqueName: \"kubernetes.io/projected/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-kube-api-access-2m4wb\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-kubelet\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-env-overrides\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cnibin\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-netns\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-agent-certs\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cnibin\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-ovn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360496 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-netns\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.360528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-socket-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-socket-dir-parent\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-multus\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4k2\" (UniqueName: \"kubernetes.io/projected/00ec031c-b852-4a3f-bb12-10ab1ec9059e-kube-api-access-4v4k2\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-daemon-config\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysconfig\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-tmp\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-node-log\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-multus\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-socket-dir-parent\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-device-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.361202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-hostroot\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-netns\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360833 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqvn\" (UniqueName: \"kubernetes.io/projected/001e0a72-06da-465d-b5fe-084554f3c448-kube-api-access-jjqvn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5vm\" (UniqueName: \"kubernetes.io/projected/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kube-api-access-vq5vm\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-dbus\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.360879 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-hostroot\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cni-binary-copy\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-systemd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.360993 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:04:40.860974339 +0000 UTC m=+2.020403150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.360996 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-dbus\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-netd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-script-lib\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.362050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8r7\" (UniqueName: \"kubernetes.io/projected/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-kube-api-access-tl8r7\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-system-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g592\" (UniqueName: \"kubernetes.io/projected/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-kube-api-access-8g592\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-conf\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-lib-modules\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361199 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-system-cni-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/001e0a72-06da-465d-b5fe-084554f3c448-ovn-node-metrics-cert\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skq7\" (UniqueName: \"kubernetes.io/projected/ed1d36e8-776e-4c3a-8449-608ecf55edf9-kube-api-access-5skq7\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-os-release\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-bin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-log-socket\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cni-binary-copy\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.362598 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-os-release\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-cni-bin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-systemd\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-sys\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.361891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-konnectivity-ca\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlsvc\" (UniqueName: \"kubernetes.io/projected/03bef4ca-9b00-461d-9bc4-7994d49b7873-kube-api-access-vlsvc\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-bin\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-config\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cnibin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-os-release\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-kubelet\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-sys-fs\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-cnibin\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-os-release\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-var-lib-kubelet\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-modprobe-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-kubernetes\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-host\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362337 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-multus-certs\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-iptables-alerter-script\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-var-lib-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-host-run-multus-certs\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-etc-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-run\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03bef4ca-9b00-461d-9bc4-7994d49b7873-hosts-file\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bef4ca-9b00-461d-9bc4-7994d49b7873-tmp-dir\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-conf-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-systemd-units\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-slash\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-registration-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00ec031c-b852-4a3f-bb12-10ab1ec9059e-multus-conf-dir\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed1d36e8-776e-4c3a-8449-608ecf55edf9-host\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-system-cni-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-var-lib-kubelet\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed1d36e8-776e-4c3a-8449-608ecf55edf9-serviceca\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.363882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27pj4\" (UniqueName: \"kubernetes.io/projected/86608abc-fc02-4953-be82-3342a1cc3cb5-kube-api-access-27pj4\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.364284 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362709 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-system-cni-dir\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.364284 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.362724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.370338 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.370324 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:40.370386 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.370340 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:40.370386 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.370348 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:40.370446 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.370394 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:40.870383991 +0000 UTC m=+2.029812787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:40.371621 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.371600 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:04:40.374297 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.374276 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4k2\" (UniqueName: \"kubernetes.io/projected/00ec031c-b852-4a3f-bb12-10ab1ec9059e-kube-api-access-4v4k2\") pod \"multus-xd9lp\" (UID: \"00ec031c-b852-4a3f-bb12-10ab1ec9059e\") " pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.374297 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.374287 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8r7\" (UniqueName: \"kubernetes.io/projected/bb4a5874-24cc-4ce6-ae29-17ac962ebbd1-kube-api-access-tl8r7\") pod \"multus-additional-cni-plugins-gghx8\" (UID: \"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1\") " pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.463883 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-registration-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.463985 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed1d36e8-776e-4c3a-8449-608ecf55edf9-host\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.463985 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-var-lib-kubelet\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.463985 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed1d36e8-776e-4c3a-8449-608ecf55edf9-serviceca\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.463985 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27pj4\" (UniqueName: \"kubernetes.io/projected/86608abc-fc02-4953-be82-3342a1cc3cb5-kube-api-access-27pj4\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463978 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-registration-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed1d36e8-776e-4c3a-8449-608ecf55edf9-host\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.463974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-host-slash\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-host-slash\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464033 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-var-lib-kubelet\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-tuned\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.464221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4wb\" (UniqueName: \"kubernetes.io/projected/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-kube-api-access-2m4wb\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-kubelet\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464340 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464357 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-kubelet\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-env-overrides\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-agent-certs\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464422 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed1d36e8-776e-4c3a-8449-608ecf55edf9-serviceca\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-ovn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-socket-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-ovn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.464589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysconfig\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-tmp\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464649 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-node-log\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-socket-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-device-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysconfig\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464731 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-netns\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-run-netns\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464768 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-node-log\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqvn\" (UniqueName: \"kubernetes.io/projected/001e0a72-06da-465d-b5fe-084554f3c448-kube-api-access-jjqvn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-device-dir\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5vm\" (UniqueName: \"kubernetes.io/projected/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kube-api-access-vq5vm\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.465254 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-env-overrides\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-systemd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.464876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-systemd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.464975 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.465052 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:40.965035889 +0000 UTC m=+2.124464695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465069 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-netd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-netd\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-script-lib\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g592\" (UniqueName: \"kubernetes.io/projected/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-kube-api-access-8g592\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-conf\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-lib-modules\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/001e0a72-06da-465d-b5fe-084554f3c448-ovn-node-metrics-cert\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skq7\" (UniqueName: \"kubernetes.io/projected/ed1d36e8-776e-4c3a-8449-608ecf55edf9-kube-api-access-5skq7\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.465950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-log-socket\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-systemd\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-sys\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-konnectivity-ca\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlsvc\" (UniqueName: \"kubernetes.io/projected/03bef4ca-9b00-461d-9bc4-7994d49b7873-kube-api-access-vlsvc\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465635 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-run-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-bin\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-config\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-sys-fs\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-conf\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-modprobe-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-kubernetes\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-host\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-iptables-alerter-script\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-lib-modules\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.466668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465848 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-script-lib\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-var-lib-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-etc-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465940 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-run\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03bef4ca-9b00-461d-9bc4-7994d49b7873-hosts-file\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bef4ca-9b00-461d-9bc4-7994d49b7873-tmp-dir\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-systemd-units\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-slash\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-log-socket\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466213 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-slash\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466265 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-systemd\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-etc-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-sys-fs\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.467279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-host\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466501 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-sys\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466627 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/001e0a72-06da-465d-b5fe-084554f3c448-ovnkube-config\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-modprobe-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-sysctl-d\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466769 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-kubernetes\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.465916 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-host-cni-bin\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-var-lib-openvswitch\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466829 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-run\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466883 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466882 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-iptables-alerter-script\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466893 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-agent-certs\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/001e0a72-06da-465d-b5fe-084554f3c448-systemd-units\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.466953 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03bef4ca-9b00-461d-9bc4-7994d49b7873-hosts-file\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.467125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bef4ca-9b00-461d-9bc4-7994d49b7873-tmp-dir\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.467818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.467235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-etc-tuned\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.468281 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.467368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bfb07ff-ffa8-4a44-9436-f5fb81775a23-konnectivity-ca\") pod \"konnectivity-agent-sxhhm\" (UID: \"9bfb07ff-ffa8-4a44-9436-f5fb81775a23\") " pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.468281 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.467379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-tmp\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.468375 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.468361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/001e0a72-06da-465d-b5fe-084554f3c448-ovn-node-metrics-cert\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.478716 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.478693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqvn\" (UniqueName: \"kubernetes.io/projected/001e0a72-06da-465d-b5fe-084554f3c448-kube-api-access-jjqvn\") pod \"ovnkube-node-ppj6q\" (UID: \"001e0a72-06da-465d-b5fe-084554f3c448\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.480940 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.480921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4wb\" (UniqueName: \"kubernetes.io/projected/10b3d7ed-072c-484e-b3f5-e0ca67902ca0-kube-api-access-2m4wb\") pod \"tuned-5nvwk\" (UID: \"10b3d7ed-072c-484e-b3f5-e0ca67902ca0\") " pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.481185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.481168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlsvc\" (UniqueName: \"kubernetes.io/projected/03bef4ca-9b00-461d-9bc4-7994d49b7873-kube-api-access-vlsvc\") pod \"node-resolver-ktzqj\" (UID: \"03bef4ca-9b00-461d-9bc4-7994d49b7873\") " pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.481276 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.481262 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27pj4\" (UniqueName: \"kubernetes.io/projected/86608abc-fc02-4953-be82-3342a1cc3cb5-kube-api-access-27pj4\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.481436 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.481416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skq7\" (UniqueName: \"kubernetes.io/projected/ed1d36e8-776e-4c3a-8449-608ecf55edf9-kube-api-access-5skq7\") pod \"node-ca-njjnk\" (UID: \"ed1d36e8-776e-4c3a-8449-608ecf55edf9\") " pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.481948 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.481929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g592\" (UniqueName: \"kubernetes.io/projected/c3926df1-7771-4e10-8f8c-ca2ea3fe8682-kube-api-access-8g592\") pod \"iptables-alerter-scc56\" (UID: \"c3926df1-7771-4e10-8f8c-ca2ea3fe8682\") " pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.482424 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.482407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5vm\" (UniqueName: \"kubernetes.io/projected/3d89d9a7-08c9-431b-8673-5aafc0b4c4d6-kube-api-access-vq5vm\") pod \"aws-ebs-csi-driver-node-ddbwn\" (UID: \"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.550317 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.550271 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:40.562264 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.562243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gghx8" Jun 08 12:04:40.567315 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.567296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xd9lp" Jun 08 12:04:40.570347 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.570321 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4a5874_24cc_4ce6_ae29_17ac962ebbd1.slice/crio-ce8dc040853e0fbc0296300959375c2442e432e53e3f5c7ba8d729ffdae2ff91 WatchSource:0}: Error finding container ce8dc040853e0fbc0296300959375c2442e432e53e3f5c7ba8d729ffdae2ff91: Status 404 returned error can't find the container with id ce8dc040853e0fbc0296300959375c2442e432e53e3f5c7ba8d729ffdae2ff91 Jun 08 12:04:40.576353 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.576332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-scc56" Jun 08 12:04:40.576776 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.576757 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ec031c_b852_4a3f_bb12_10ab1ec9059e.slice/crio-a6f01ec3fcb806118a56c36a327d463c91e27b27d7c2de8a189a1b651ab45254 WatchSource:0}: Error finding container a6f01ec3fcb806118a56c36a327d463c91e27b27d7c2de8a189a1b651ab45254: Status 404 returned error can't find the container with id a6f01ec3fcb806118a56c36a327d463c91e27b27d7c2de8a189a1b651ab45254 Jun 08 12:04:40.581205 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.581187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:04:40.584779 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.584739 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3926df1_7771_4e10_8f8c_ca2ea3fe8682.slice/crio-3173e89e931722cb29f1e9022d57dcf3fd2b158a07786b2224326f7725e2ae94 WatchSource:0}: Error finding container 3173e89e931722cb29f1e9022d57dcf3fd2b158a07786b2224326f7725e2ae94: Status 404 returned error can't find the container with id 3173e89e931722cb29f1e9022d57dcf3fd2b158a07786b2224326f7725e2ae94 Jun 08 12:04:40.585763 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.585744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" Jun 08 12:04:40.590996 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.590979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" Jun 08 12:04:40.592377 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.592342 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001e0a72_06da_465d_b5fe_084554f3c448.slice/crio-75e5d2dc8ae3fc8b9c37798c8f9522d338da5c20176035dc3e4201dd5998cb89 WatchSource:0}: Error finding container 75e5d2dc8ae3fc8b9c37798c8f9522d338da5c20176035dc3e4201dd5998cb89: Status 404 returned error can't find the container with id 75e5d2dc8ae3fc8b9c37798c8f9522d338da5c20176035dc3e4201dd5998cb89 Jun 08 12:04:40.595786 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.595763 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d89d9a7_08c9_431b_8673_5aafc0b4c4d6.slice/crio-3f27294229bd04edf31d483ce52cfb7f80196fbe87057f7c83438db520795229 WatchSource:0}: Error finding container 3f27294229bd04edf31d483ce52cfb7f80196fbe87057f7c83438db520795229: Status 404 returned error can't find the container with id 3f27294229bd04edf31d483ce52cfb7f80196fbe87057f7c83438db520795229 Jun 08 12:04:40.599359 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.599338 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b3d7ed_072c_484e_b3f5_e0ca67902ca0.slice/crio-b77f8f343a02589a7d1302505d7ab1eaa2b31c2905ba6c2e0b557609ae49e4e1 WatchSource:0}: Error finding container b77f8f343a02589a7d1302505d7ab1eaa2b31c2905ba6c2e0b557609ae49e4e1: Status 404 returned error can't find the container with id b77f8f343a02589a7d1302505d7ab1eaa2b31c2905ba6c2e0b557609ae49e4e1 Jun 08 12:04:40.600605 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.600587 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:04:40.606117 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.606077 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktzqj" Jun 08 12:04:40.610802 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.610783 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njjnk" Jun 08 12:04:40.613884 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.613858 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfb07ff_ffa8_4a44_9436_f5fb81775a23.slice/crio-ac51407f32b4c9cc61c7dff64330b6dc57e3aa65dd1252498d19cf27e9d5df27 WatchSource:0}: Error finding container ac51407f32b4c9cc61c7dff64330b6dc57e3aa65dd1252498d19cf27e9d5df27: Status 404 returned error can't find the container with id ac51407f32b4c9cc61c7dff64330b6dc57e3aa65dd1252498d19cf27e9d5df27 Jun 08 12:04:40.617978 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.617942 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bef4ca_9b00_461d_9bc4_7994d49b7873.slice/crio-5d902b4e170ae0bca5976cd977c458cb5638d830a67ec15c3df4cc283731a961 WatchSource:0}: Error finding container 5d902b4e170ae0bca5976cd977c458cb5638d830a67ec15c3df4cc283731a961: Status 404 returned error can't find the container with id 5d902b4e170ae0bca5976cd977c458cb5638d830a67ec15c3df4cc283731a961 Jun 08 12:04:40.623135 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:04:40.623093 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1d36e8_776e_4c3a_8449_608ecf55edf9.slice/crio-22e86daba7a7dd76b282775960fcdef2515c3f6b1f53c330ba4ed8a70dd46b50 WatchSource:0}: Error finding container 22e86daba7a7dd76b282775960fcdef2515c3f6b1f53c330ba4ed8a70dd46b50: Status 404 returned error can't find the container with id 22e86daba7a7dd76b282775960fcdef2515c3f6b1f53c330ba4ed8a70dd46b50 Jun 08 12:04:40.703412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.703093 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:40.869180 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.869149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:40.869341 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.869322 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:40.869406 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.869390 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.869371079 +0000 UTC m=+3.028799874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.970390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:40.970446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.970618 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.970699 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.970680699 +0000 UTC m=+3.130109493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.971152 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.971174 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.971187 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:40.971752 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:40.971240 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.971224113 +0000 UTC m=+3.130652922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.325380 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.325322 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:59:40 +0000 UTC" deadline="2027-12-25 11:48:51.369726365 +0000 UTC" Jun 08 12:04:41.325380 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.325379 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13559h44m10.044351342s" Jun 08 12:04:41.352343 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.352262 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njjnk" event={"ID":"ed1d36e8-776e-4c3a-8449-608ecf55edf9","Type":"ContainerStarted","Data":"22e86daba7a7dd76b282775960fcdef2515c3f6b1f53c330ba4ed8a70dd46b50"} Jun 08 12:04:41.362321 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.362242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sxhhm" event={"ID":"9bfb07ff-ffa8-4a44-9436-f5fb81775a23","Type":"ContainerStarted","Data":"ac51407f32b4c9cc61c7dff64330b6dc57e3aa65dd1252498d19cf27e9d5df27"} Jun 08 12:04:41.366093 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.365991 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"75e5d2dc8ae3fc8b9c37798c8f9522d338da5c20176035dc3e4201dd5998cb89"} Jun 08 12:04:41.368092 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.368026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-scc56" event={"ID":"c3926df1-7771-4e10-8f8c-ca2ea3fe8682","Type":"ContainerStarted","Data":"3173e89e931722cb29f1e9022d57dcf3fd2b158a07786b2224326f7725e2ae94"} Jun 08 12:04:41.370417 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.370335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerStarted","Data":"ce8dc040853e0fbc0296300959375c2442e432e53e3f5c7ba8d729ffdae2ff91"} Jun 08 12:04:41.381238 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.381160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktzqj" event={"ID":"03bef4ca-9b00-461d-9bc4-7994d49b7873","Type":"ContainerStarted","Data":"5d902b4e170ae0bca5976cd977c458cb5638d830a67ec15c3df4cc283731a961"} Jun 08 12:04:41.391049 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.390972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" event={"ID":"10b3d7ed-072c-484e-b3f5-e0ca67902ca0","Type":"ContainerStarted","Data":"b77f8f343a02589a7d1302505d7ab1eaa2b31c2905ba6c2e0b557609ae49e4e1"} Jun 08 12:04:41.398050 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.398025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" event={"ID":"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6","Type":"ContainerStarted","Data":"3f27294229bd04edf31d483ce52cfb7f80196fbe87057f7c83438db520795229"} Jun 08 12:04:41.403804 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.403777 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xd9lp" event={"ID":"00ec031c-b852-4a3f-bb12-10ab1ec9059e","Type":"ContainerStarted","Data":"a6f01ec3fcb806118a56c36a327d463c91e27b27d7c2de8a189a1b651ab45254"} Jun 08 12:04:41.579439 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.579365 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:41.878720 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.878639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:41.878872 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.878804 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.878872 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.878862 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:04:43.878843244 +0000 UTC m=+5.038272051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.979341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.979308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:41.979516 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:41.979359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:41.979578 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.979539 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.979627 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.979599 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:43.97957888 +0000 UTC m=+5.139007672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.980014 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.979968 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:41.980014 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.979990 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:41.980014 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.980001 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.980202 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:41.980033 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:43.980022163 +0000 UTC m=+5.139450955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:42.015990 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.015964 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.321994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.322014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.322014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:42.322135 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:42.322247 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:42.322514 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:42.322341 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:42.326136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.326018 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:59:40 +0000 UTC" deadline="2027-11-02 02:18:22.451627292 +0000 UTC" Jun 08 12:04:42.326136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:42.326046 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12278h13m40.125586371s" Jun 08 12:04:43.895573 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:43.895536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:43.896018 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.895733 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:43.896018 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.895831 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:04:47.895783732 +0000 UTC m=+9.055212537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:43.996783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:43.996830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.996964 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.997035 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:47.99700899 +0000 UTC m=+9.156437842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.997139 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:43.997192 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:43.997165 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:44.001653 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:44.001615 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:44.001777 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:44.001734 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:48.001700933 +0000 UTC m=+9.161129740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:44.321865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:44.321709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:44.321865 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:44.321831 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:44.322222 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:44.322204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:44.322332 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:44.322310 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:44.322402 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:44.322372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:44.322499 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:44.322461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:46.321358 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:46.321329 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:46.321811 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:46.321329 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:46.321811 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:46.321463 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:46.321811 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:46.321455 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:46.321811 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:46.321577 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:46.321811 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:46.321667 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:47.929338 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:47.929289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:47.929773 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:47.929489 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:47.929773 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:47.929587 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:04:55.929548888 +0000 UTC m=+17.088977683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:48.030467 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:48.030434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:48.030632 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:48.030493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:48.030632 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.030625 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:48.030750 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.030683 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:56.030664077 +0000 UTC m=+17.190092883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:48.031193 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.031065 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:48.031193 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.031089 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:48.031193 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.031117 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:48.031193 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.031164 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:56.03114719 +0000 UTC m=+17.190575985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:48.321812 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:48.321738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:48.321943 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.321869 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:48.322360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:48.322213 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:48.322360 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.322325 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:48.322553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:48.322403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:48.322553 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:48.322508 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:50.321772 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:50.321744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:50.322285 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:50.321741 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:50.322285 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:50.321855 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:50.322285 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:50.321746 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:50.322285 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:50.321942 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:50.322285 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:50.322036 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:52.321875 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:52.321845 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:52.321875 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:52.321868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:52.322343 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:52.321937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:52.322343 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:52.322045 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:52.322343 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:52.322133 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:52.322343 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:52.322252 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:54.321402 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:54.321366 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:54.321823 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:54.321482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:54.321823 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:54.321490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:54.321823 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:54.321532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:54.321823 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:54.321618 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:54.321823 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:54.321675 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:55.995884 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:55.995849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:55.996320 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:55.995999 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:55.996320 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:55.996065 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:05:11.996049273 +0000 UTC m=+33.155478066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:56.096777 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:56.096752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:56.096928 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:56.096790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:56.096987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.096929 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:56.096987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.096953 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:56.096987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.096964 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:56.096987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.096980 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:56.097172 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.097011 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:12.096997722 +0000 UTC m=+33.256426514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:56.097172 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.097029 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:12.097019942 +0000 UTC m=+33.256448734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:56.321889 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:56.321809 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:56.321889 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:56.321843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:56.322120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:56.321917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:56.322120 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.321935 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:56.322120 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.322008 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:04:56.322120 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:56.322072 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:58.321628 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:58.321592 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:04:58.322034 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:58.321641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:04:58.322034 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:04:58.321642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:04:58.322034 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:58.321728 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:04:58.322034 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:58.321831 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:04:58.322034 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:04:58.321908 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:00.321923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:00.321897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:00.321923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:00.321914 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:00.322287 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:00.321908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:00.322287 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:00.321987 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:00.322287 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:00.322075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:00.322287 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:00.322161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:01.454915 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.454557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" event={"ID":"34104b1ff5ad84f1a4b34f9808ccb83e","Type":"ContainerStarted","Data":"cb76cbce94ca73b6a5b801fe0cc6d735b32c5bd87d423ebd22d73080b6937ee7"} Jun 08 12:05:01.456064 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.456039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktzqj" event={"ID":"03bef4ca-9b00-461d-9bc4-7994d49b7873","Type":"ContainerStarted","Data":"141c3fff3f8b63a46dde495bad98224cc2ddd033b712486fb43b0325569318c9"} Jun 08 12:05:01.457420 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.457395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" event={"ID":"10b3d7ed-072c-484e-b3f5-e0ca67902ca0","Type":"ContainerStarted","Data":"d0de949561dd89be72a091afcad0f5c8808a603c2e139498183741e5e3e0c39e"} Jun 08 12:05:01.460645 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.460622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" event={"ID":"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6","Type":"ContainerStarted","Data":"23ab586df97a07cdf216ec0ce2f538e53f6390c1af7f43891ed6293f94c7492d"} Jun 08 12:05:01.462215 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.462194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xd9lp" event={"ID":"00ec031c-b852-4a3f-bb12-10ab1ec9059e","Type":"ContainerStarted","Data":"e8c3d097b555f97123fca1ebc5ffec50587ebb43b883e9839ddb33cd8b624899"} Jun 08 12:05:01.463523 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.463497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njjnk" event={"ID":"ed1d36e8-776e-4c3a-8449-608ecf55edf9","Type":"ContainerStarted","Data":"203a55ef02b16b67e17d4db2018d901b382a71a4eeb3314193abc7a849b87efe"} Jun 08 12:05:01.464696 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.464671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sxhhm" event={"ID":"9bfb07ff-ffa8-4a44-9436-f5fb81775a23","Type":"ContainerStarted","Data":"c3ef4733486a5e7ba1ba7a4cb40b0d8ea735e0fb043de417e4af36ab530365cc"} Jun 08 12:05:01.467350 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"27ebe20a9941dbcd968498fc92383125511f0903a3c1839d54285d3c0a76332e"} Jun 08 12:05:01.467445 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"8b8770931ef847ce71af72d38abd427444201e6229f5242964f8a2b965fd11cc"} Jun 08 12:05:01.467506 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467449 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"8ebe083eede7e8a1ebfb74ce4be549a6209e01b34b25768fd7845733a8b735f7"} Jun 08 12:05:01.467506 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"eca0574ded8917b33356d6d82b6ee557866866321a3e1d6153e54a6a3cf3d002"} Jun 08 12:05:01.467615 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"683cba4ea8fb17febabc5346270025db50ef15e07e25d5b14183b187c216b88f"} Jun 08 12:05:01.467615 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.467593 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"268fbd78af38cae3eb471bf1136c46485efc6cb91b74160a9333cdfd25944212"} Jun 08 12:05:01.468761 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.468742 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="5da6f210390bc1c5bc317d8724431a4548de8cf6b46a7aee08dec5043ff6e996" exitCode=0 Jun 08 12:05:01.468846 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.468801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"5da6f210390bc1c5bc317d8724431a4548de8cf6b46a7aee08dec5043ff6e996"} Jun 08 12:05:01.470257 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.470204 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-69.ec2.internal" podStartSLOduration=21.470188056 podStartE2EDuration="21.470188056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.469958368 +0000 UTC m=+22.629387205" watchObservedRunningTime="2026-06-08 12:05:01.470188056 +0000 UTC m=+22.629616871" Jun 08 12:05:01.470506 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.470489 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8d6a6bcb90b30930eb9f859bfb2eadf" containerID="e83f1b524fe087c6a93566b46287604fd7d09a141fd16501f7182f7cad039353" exitCode=0 Jun 08 12:05:01.470568 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.470515 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" event={"ID":"a8d6a6bcb90b30930eb9f859bfb2eadf","Type":"ContainerDied","Data":"e83f1b524fe087c6a93566b46287604fd7d09a141fd16501f7182f7cad039353"} Jun 08 12:05:01.511837 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.511798 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ktzqj" podStartSLOduration=2.851800351 podStartE2EDuration="22.511780853s" totalImagesPullingTime="19.659980502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.511213822 +0000 UTC m=+22.670642618" watchObservedRunningTime="2026-06-08 12:05:01.511780853 +0000 UTC m=+22.671209670" Jun 08 12:05:01.554350 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.554208 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xd9lp" podStartSLOduration=2.844337984 podStartE2EDuration="22.554196567s" totalImagesPullingTime="19.709858583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.535500106 +0000 UTC m=+22.694928921" watchObservedRunningTime="2026-06-08 12:05:01.554196567 +0000 UTC m=+22.713625380" Jun 08 12:05:01.571725 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.571692 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5nvwk" podStartSLOduration=2.893927167 podStartE2EDuration="22.571680415s" totalImagesPullingTime="19.677753248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.554431768 +0000 UTC m=+22.713860574" watchObservedRunningTime="2026-06-08 12:05:01.571680415 +0000 UTC m=+22.731109228" Jun 08 12:05:01.592177 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:01.592135 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sxhhm" podStartSLOduration=2.953737148 podStartE2EDuration="22.592124168s" totalImagesPullingTime="19.63838702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.572827481 +0000 UTC m=+22.732256307" watchObservedRunningTime="2026-06-08 12:05:01.592124168 +0000 UTC m=+22.751552978" Jun 08 12:05:02.321471 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.321435 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:02.321471 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.321455 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:02.321649 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:02.321566 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:02.321649 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:02.321632 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:02.321877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.321691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:02.321877 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:02.321770 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:02.434643 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.434619 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:05:02.475078 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.475056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" event={"ID":"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6","Type":"ContainerStarted","Data":"f3ea2c21a0162d94abe63de82ef88d3794872e9e779423fdd55dea553c23aadc"} Jun 08 12:05:02.476561 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.476539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-scc56" event={"ID":"c3926df1-7771-4e10-8f8c-ca2ea3fe8682","Type":"ContainerStarted","Data":"3ce0fee3007607af84d52a0c3cbe167bf7519beb8f492be9af64befe21c49241"} Jun 08 12:05:02.501004 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.500957 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-njjnk" podStartSLOduration=3.846262232 podStartE2EDuration="23.500940198s" totalImagesPullingTime="19.654677966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.592218276 +0000 UTC m=+22.751647091" watchObservedRunningTime="2026-06-08 12:05:02.500940198 +0000 UTC m=+23.660369014" Jun 08 12:05:02.518555 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:02.518521 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-scc56" podStartSLOduration=3.850936227 podStartE2EDuration="23.518508282s" totalImagesPullingTime="19.667572055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:02.500455226 +0000 UTC m=+23.659884066" watchObservedRunningTime="2026-06-08 12:05:02.518508282 +0000 UTC m=+23.677937096" Jun 08 12:05:03.347195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.347056 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:05:02.434635586Z","UUID":"6b921e98-3730-41de-834e-0bdf9628c66b","Handler":null,"Name":"","Endpoint":""} Jun 08 12:05:03.348698 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.348675 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:05:03.348824 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.348723 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:05:03.482756 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.482693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"59783e71033893130913242b1703e86f25707903496a2ae037100505c37fe8a7"} Jun 08 12:05:03.485090 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.485051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" event={"ID":"a8d6a6bcb90b30930eb9f859bfb2eadf","Type":"ContainerStarted","Data":"d48803516e8ef6bb74f5fb2307cc4ea22a23f428c760aa4521fde4d487af422b"} Jun 08 12:05:03.501705 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:03.501600 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-69.ec2.internal" podStartSLOduration=23.501583572 podStartE2EDuration="23.501583572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:03.501519285 +0000 UTC m=+24.660948099" watchObservedRunningTime="2026-06-08 12:05:03.501583572 +0000 UTC m=+24.661012388" Jun 08 12:05:04.321723 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.321697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:04.321987 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.321787 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:04.321987 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.321830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:04.321987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:04.321814 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:04.321987 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:04.321936 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:04.322202 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:04.322016 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:04.489452 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.489415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" event={"ID":"3d89d9a7-08c9-431b-8673-5aafc0b4c4d6","Type":"ContainerStarted","Data":"59e972b843feb45a899508dcc40911a276d7b1d1d9a5403fbf4b25f87a048af4"} Jun 08 12:05:04.515740 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.515690 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddbwn" podStartSLOduration=3.457444791 podStartE2EDuration="25.515670679s" totalImagesPullingTime="22.058225888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:04.515320426 +0000 UTC m=+25.674749241" watchObservedRunningTime="2026-06-08 12:05:04.515670679 +0000 UTC m=+25.675099495" Jun 08 12:05:04.848092 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.848061 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:05:04.848902 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:04.848882 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:05:06.321738 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.321583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:06.322137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.321626 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:06.322137 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:06.321798 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:06.322137 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:06.321877 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:06.322137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.321632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:06.322137 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:06.321943 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:06.496796 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.496758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" event={"ID":"001e0a72-06da-465d-b5fe-084554f3c448","Type":"ContainerStarted","Data":"17e06c19481dc6fc7b3595eb16075735373ee7cfe0d9acbf63e70758041d4f5b"} Jun 08 12:05:06.497155 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.497131 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:06.498912 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.498877 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="ea0c5a01bc7299200383d0805f134f0f770946ea3800a5e6bdd2580ecefd2c21" exitCode=0 Jun 08 12:05:06.499017 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.498936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"ea0c5a01bc7299200383d0805f134f0f770946ea3800a5e6bdd2580ecefd2c21"} Jun 08 12:05:06.513607 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.513586 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:06.530925 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:06.530859 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" podStartSLOduration=7.54659814 podStartE2EDuration="27.530847557s" totalImagesPullingTime="19.984249417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:06.530180088 +0000 UTC m=+27.689608902" watchObservedRunningTime="2026-06-08 12:05:06.530847557 +0000 UTC m=+27.690276371" Jun 08 12:05:07.504127 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.503876 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="f68350bbafa1bb616c3a2b9cb3fd98252956413967cae28b8ab37347e5c4585a" exitCode=0 Jun 08 12:05:07.504127 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.503959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"f68350bbafa1bb616c3a2b9cb3fd98252956413967cae28b8ab37347e5c4585a"} Jun 08 12:05:07.504849 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.504546 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:07.504849 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.504618 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:07.518409 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.518390 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:07.794918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.794848 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mjdl2"] Jun 08 12:05:07.795065 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.794974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:07.795150 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:07.795094 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:07.797833 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.797805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7swr"] Jun 08 12:05:07.797945 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.797911 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:07.798022 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:07.798004 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:07.798399 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.798380 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57jf7"] Jun 08 12:05:07.798503 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:07.798478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:07.798581 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:07.798561 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:09.280058 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.280030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:05:09.280767 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.280210 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:05:09.280767 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.280703 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sxhhm" Jun 08 12:05:09.322893 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.322861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:09.323058 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.322969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:09.323058 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:09.322966 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:09.323058 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.323025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:09.323219 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:09.323144 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:09.323263 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:09.323224 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:09.511374 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.511345 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="cdcebec37f1a6fc0c8076e35ea19ab8e34da7f2bb068a379337c567eaa403eaf" exitCode=0 Jun 08 12:05:09.511540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:09.511424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"cdcebec37f1a6fc0c8076e35ea19ab8e34da7f2bb068a379337c567eaa403eaf"} Jun 08 12:05:11.321862 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:11.321659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:11.322378 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:11.321682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:11.322378 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:11.321966 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57jf7" podUID="d8d587e6-444d-4114-9ecc-fcb6e8e9e208" Jun 08 12:05:11.322378 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:11.321709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:11.322378 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:11.322072 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:05:11.322378 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:11.322114 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7swr" podUID="c06b5b67-d121-4e4f-9fcc-9161f9f8defc" Jun 08 12:05:12.019857 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:12.019825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:12.020020 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.019932 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:05:12.020020 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.019991 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret podName:c06b5b67-d121-4e4f-9fcc-9161f9f8defc nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.019972256 +0000 UTC m=+65.179401053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret") pod "global-pull-secret-syncer-v7swr" (UID: "c06b5b67-d121-4e4f-9fcc-9161f9f8defc") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:05:12.120666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:12.120630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:12.120848 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:12.120682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:12.120848 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120794 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:05:12.120848 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120842 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.12082955 +0000 UTC m=+65.280258342 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:05:12.120970 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120794 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:05:12.120970 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120896 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:05:12.120970 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120908 2575 projected.go:196] Error preparing data for projected volume kube-api-access-cdgpf for pod openshift-network-diagnostics/network-check-target-57jf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:05:12.120970 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:12.120952 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf podName:d8d587e6-444d-4114-9ecc-fcb6e8e9e208 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.120939517 +0000 UTC m=+65.280368322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdgpf" (UniqueName: "kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf") pod "network-check-target-57jf7" (UID: "d8d587e6-444d-4114-9ecc-fcb6e8e9e208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:05:13.119324 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.119299 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-69.ec2.internal" event="NodeReady" Jun 08 12:05:13.119743 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.119443 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:05:13.201806 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.201773 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5x29n"] Jun 08 12:05:13.204843 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.204822 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.205434 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.205411 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-grctn"] Jun 08 12:05:13.207212 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.207182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:13.208499 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.208478 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:05:13.208781 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.208758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcszh\"" Jun 08 12:05:13.209332 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.209305 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-69.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-132-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 08 12:05:13.209332 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.209321 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-69.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-132-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 08 12:05:13.209490 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.209305 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-p7rkr\" is forbidden: User \"system:node:ip-10-0-132-69.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-132-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7rkr\"" type="*v1.Secret" Jun 08 12:05:13.210468 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.210443 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-132-69.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-132-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" Jun 08 12:05:13.212681 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.212635 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:05:13.220771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.220749 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x29n"] Jun 08 12:05:13.225664 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.225639 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-grctn"] Jun 08 12:05:13.322190 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.322168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:13.322367 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.322346 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:13.322486 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.322352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:13.326733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326661 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:05:13.326733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326686 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:05:13.326946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326686 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5xcw\"" Jun 08 12:05:13.326946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jxz55\"" Jun 08 12:05:13.326946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326870 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:05:13.326946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.326669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:05:13.330003 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.329978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5188f961-40a6-4f73-a72b-393c254a714c-tmp-dir\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.330137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.330029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvtcd\" (UniqueName: \"kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:13.330137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.330072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.330250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.330182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6825ab2c-f39b-43b2-a676-cc2804c6d53a-cert\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:13.330295 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.330245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5188f961-40a6-4f73-a72b-393c254a714c-config-volume\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.330345 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.330294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkj9\" (UniqueName: \"kubernetes.io/projected/5188f961-40a6-4f73-a72b-393c254a714c-kube-api-access-nxkj9\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.430648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtcd\" (UniqueName: \"kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:13.430768 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.430768 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.430752 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:13.430874 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.430805 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:13.930789836 +0000 UTC m=+35.090218628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:13.430935 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6825ab2c-f39b-43b2-a676-cc2804c6d53a-cert\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:13.430984 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5188f961-40a6-4f73-a72b-393c254a714c-config-volume\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.430984 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkj9\" (UniqueName: \"kubernetes.io/projected/5188f961-40a6-4f73-a72b-393c254a714c-kube-api-access-nxkj9\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.431076 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.430996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5188f961-40a6-4f73-a72b-393c254a714c-tmp-dir\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.431397 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.431377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5188f961-40a6-4f73-a72b-393c254a714c-tmp-dir\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.431591 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.431573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5188f961-40a6-4f73-a72b-393c254a714c-config-volume\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.441054 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.441035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkj9\" (UniqueName: \"kubernetes.io/projected/5188f961-40a6-4f73-a72b-393c254a714c-kube-api-access-nxkj9\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.933911 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:13.933881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:13.934047 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.933989 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:13.934086 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:13.934051 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:14.934037695 +0000 UTC m=+36.093466487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:14.278858 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.278794 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:05:14.283893 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.283860 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6825ab2c-f39b-43b2-a676-cc2804c6d53a-cert\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:14.437876 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:14.437841 2575 projected.go:291] Couldn't get configMap openshift-ingress-canary/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 08 12:05:14.445480 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.445458 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7rkr\"" Jun 08 12:05:14.525780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.525750 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="8bdf1279a8b4f84924e88b6b623a4680f3c479164eed72e099bd42eee2052cdc" exitCode=0 Jun 08 12:05:14.525888 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.525790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"8bdf1279a8b4f84924e88b6b623a4680f3c479164eed72e099bd42eee2052cdc"} Jun 08 12:05:14.530357 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.530341 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:05:14.538503 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:14.538474 2575 projected.go:196] Error preparing data for projected volume kube-api-access-bvtcd for pod openshift-ingress-canary/ingress-canary-grctn: failed to sync configmap cache: timed out waiting for the condition Jun 08 12:05:14.538668 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:14.538533 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd podName:6825ab2c-f39b-43b2-a676-cc2804c6d53a nodeName:}" failed. No retries permitted until 2026-06-08 12:05:15.038516755 +0000 UTC m=+36.197945548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bvtcd" (UniqueName: "kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd") pod "ingress-canary-grctn" (UID: "6825ab2c-f39b-43b2-a676-cc2804c6d53a") : failed to sync configmap cache: timed out waiting for the condition Jun 08 12:05:14.804094 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.804042 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:05:14.941091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:14.941062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:14.941193 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:14.941171 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:14.941234 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:14.941219 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:16.941205045 +0000 UTC m=+38.100633837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:15.041368 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.041339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtcd\" (UniqueName: \"kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:15.044417 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.044395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvtcd\" (UniqueName: \"kubernetes.io/projected/6825ab2c-f39b-43b2-a676-cc2804c6d53a-kube-api-access-bvtcd\") pod \"ingress-canary-grctn\" (UID: \"6825ab2c-f39b-43b2-a676-cc2804c6d53a\") " pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:15.321266 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.321239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-grctn" Jun 08 12:05:15.454782 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.454648 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-grctn"] Jun 08 12:05:15.457856 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:05:15.457830 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6825ab2c_f39b_43b2_a676_cc2804c6d53a.slice/crio-0e5216dc4c565e1a7468eff0ae1c752ea4c51d00d837f97b9acceca65cbde262 WatchSource:0}: Error finding container 0e5216dc4c565e1a7468eff0ae1c752ea4c51d00d837f97b9acceca65cbde262: Status 404 returned error can't find the container with id 0e5216dc4c565e1a7468eff0ae1c752ea4c51d00d837f97b9acceca65cbde262 Jun 08 12:05:15.531317 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.531294 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb4a5874-24cc-4ce6-ae29-17ac962ebbd1" containerID="244449d7b3fc2b087c4a71f69cc3600a065e5f5ecc916162b5fc931de1a8edfa" exitCode=0 Jun 08 12:05:15.531414 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.531378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerDied","Data":"244449d7b3fc2b087c4a71f69cc3600a065e5f5ecc916162b5fc931de1a8edfa"} Jun 08 12:05:15.532567 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:15.532544 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-grctn" event={"ID":"6825ab2c-f39b-43b2-a676-cc2804c6d53a","Type":"ContainerStarted","Data":"0e5216dc4c565e1a7468eff0ae1c752ea4c51d00d837f97b9acceca65cbde262"} Jun 08 12:05:16.540125 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:16.539873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gghx8" event={"ID":"bb4a5874-24cc-4ce6-ae29-17ac962ebbd1","Type":"ContainerStarted","Data":"00eae922ab2f7399f2179ac05bbaf9d5da70f0277c61bb84a18e16a662982f54"} Jun 08 12:05:16.956703 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:16.956440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:16.956873 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:16.956561 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:16.956939 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:16.956876 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:20.956857146 +0000 UTC m=+42.116285943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:17.543805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.543772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-grctn" event={"ID":"6825ab2c-f39b-43b2-a676-cc2804c6d53a","Type":"ContainerStarted","Data":"31ce3fef6c0e25b8d8179abdba73558071cf8a00c171992602a2dd32a917bb01"} Jun 08 12:05:17.565293 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.565249 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-grctn" podStartSLOduration=2.94243366 podStartE2EDuration="4.565212042s" totalImagesPullingTime="1.622778382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:17.564134449 +0000 UTC m=+38.723563262" watchObservedRunningTime="2026-06-08 12:05:17.565212042 +0000 UTC m=+38.724640848" Jun 08 12:05:17.565420 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.565402 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gghx8" podStartSLOduration=9.128403905 podStartE2EDuration="38.565395037s" totalImagesPullingTime="29.436991132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:16.573038194 +0000 UTC m=+37.732467007" watchObservedRunningTime="2026-06-08 12:05:17.565395037 +0000 UTC m=+38.724823851" Jun 08 12:05:17.593215 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.593193 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6"] Jun 08 12:05:17.601892 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.601873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.604693 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.604675 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 12:05:17.605755 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.605741 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 12:05:17.605833 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.605742 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 12:05:17.606390 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.606372 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 12:05:17.606458 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.606428 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 12:05:17.606515 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.606464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 12:05:17.606710 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.606693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 12:05:17.618047 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.618029 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6"] Jun 08 12:05:17.765042 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbgvq\" (UniqueName: \"kubernetes.io/projected/788a8bf8-aaed-46a8-93eb-461f86358abc-kube-api-access-xbgvq\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.765200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.765200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.765200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.765200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/788a8bf8-aaed-46a8-93eb-461f86358abc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.765350 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.765280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866318 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866318 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbgvq\" (UniqueName: \"kubernetes.io/projected/788a8bf8-aaed-46a8-93eb-461f86358abc-kube-api-access-xbgvq\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866318 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.866492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.866388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/788a8bf8-aaed-46a8-93eb-461f86358abc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.867300 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.867054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/788a8bf8-aaed-46a8-93eb-461f86358abc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.869613 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.869588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.869685 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.869619 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.869735 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.869712 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-ca\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.869937 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.869918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/788a8bf8-aaed-46a8-93eb-461f86358abc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.875022 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.874997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbgvq\" (UniqueName: \"kubernetes.io/projected/788a8bf8-aaed-46a8-93eb-461f86358abc-kube-api-access-xbgvq\") pod \"cluster-proxy-proxy-agent-7999f54f8-gzkh6\" (UID: \"788a8bf8-aaed-46a8-93eb-461f86358abc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:17.919682 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:17.919651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:05:18.076920 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:18.076892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6"] Jun 08 12:05:18.079420 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:05:18.079399 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod788a8bf8_aaed_46a8_93eb_461f86358abc.slice/crio-83b223b7c622f999d2a7d66c9d4a9d24fedc0d78b48643278c3bdfed0ea62fc3 WatchSource:0}: Error finding container 83b223b7c622f999d2a7d66c9d4a9d24fedc0d78b48643278c3bdfed0ea62fc3: Status 404 returned error can't find the container with id 83b223b7c622f999d2a7d66c9d4a9d24fedc0d78b48643278c3bdfed0ea62fc3 Jun 08 12:05:18.546702 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:18.546673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerStarted","Data":"83b223b7c622f999d2a7d66c9d4a9d24fedc0d78b48643278c3bdfed0ea62fc3"} Jun 08 12:05:20.987552 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:20.987514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:20.987985 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:20.987677 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:20.987985 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:20.987756 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:28.987736364 +0000 UTC m=+50.147165156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:24.562931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:24.562893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerStarted","Data":"49121dd2924beca8d43fa9ff052e36811e025e6cdca40f1faba30238e8c0bd11"} Jun 08 12:05:24.563412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:24.562941 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerStarted","Data":"8f5c91a1eff3522e288c4fde24e0e75621b771b40febf34d872f06f6c2de0279"} Jun 08 12:05:24.563412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:24.562954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerStarted","Data":"e5cf66e28c13abfd3eabf581d9aa5638f27eb8a5726fb092ab256630c41134bc"} Jun 08 12:05:24.590127 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:24.590069 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" podStartSLOduration=2.182771571 podStartE2EDuration="7.590054415s" totalImagesPullingTime="5.407282844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:24.589621935 +0000 UTC m=+45.749050748" watchObservedRunningTime="2026-06-08 12:05:24.590054415 +0000 UTC m=+45.749483229" Jun 08 12:05:29.038413 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:29.038375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:29.038825 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:29.038531 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:29.038825 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:29.038610 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:05:45.038591252 +0000 UTC m=+66.198020052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:39.521805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:39.521781 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppj6q" Jun 08 12:05:44.035006 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.034961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:44.037941 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.037921 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:05:44.047565 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.047542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c06b5b67-d121-4e4f-9fcc-9161f9f8defc-original-pull-secret\") pod \"global-pull-secret-syncer-v7swr\" (UID: \"c06b5b67-d121-4e4f-9fcc-9161f9f8defc\") " pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:44.136017 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.135985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:44.136154 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.136022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:05:44.138946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.138927 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:05:44.138998 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.138964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:05:44.146228 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:44.146207 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:05:44.146294 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:44.146277 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:06:48.146261613 +0000 UTC m=+129.305690404 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : secret "metrics-daemon-secret" not found Jun 08 12:05:44.150302 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.150280 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:05:44.159174 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.159146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdgpf\" (UniqueName: \"kubernetes.io/projected/d8d587e6-444d-4114-9ecc-fcb6e8e9e208-kube-api-access-cdgpf\") pod \"network-check-target-57jf7\" (UID: \"d8d587e6-444d-4114-9ecc-fcb6e8e9e208\") " pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:44.236113 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.236091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7swr" Jun 08 12:05:44.251153 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.251135 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5xcw\"" Jun 08 12:05:44.258568 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.258555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:44.415590 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.415546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7swr"] Jun 08 12:05:44.418239 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:05:44.418212 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06b5b67_d121_4e4f_9fcc_9161f9f8defc.slice/crio-22ca47f296ded8cca4469925f46b0e23781b9a50b40e3c343473e7e1b514dffa WatchSource:0}: Error finding container 22ca47f296ded8cca4469925f46b0e23781b9a50b40e3c343473e7e1b514dffa: Status 404 returned error can't find the container with id 22ca47f296ded8cca4469925f46b0e23781b9a50b40e3c343473e7e1b514dffa Jun 08 12:05:44.430555 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.430531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57jf7"] Jun 08 12:05:44.432866 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:05:44.432840 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d587e6_444d_4114_9ecc_fcb6e8e9e208.slice/crio-280e83ed16495743c57f5e5bad4181013703ba3100bfe84cfbb997797a079d5f WatchSource:0}: Error finding container 280e83ed16495743c57f5e5bad4181013703ba3100bfe84cfbb997797a079d5f: Status 404 returned error can't find the container with id 280e83ed16495743c57f5e5bad4181013703ba3100bfe84cfbb997797a079d5f Jun 08 12:05:44.612378 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.612321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57jf7" event={"ID":"d8d587e6-444d-4114-9ecc-fcb6e8e9e208","Type":"ContainerStarted","Data":"280e83ed16495743c57f5e5bad4181013703ba3100bfe84cfbb997797a079d5f"} Jun 08 12:05:44.613471 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:44.613450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7swr" event={"ID":"c06b5b67-d121-4e4f-9fcc-9161f9f8defc","Type":"ContainerStarted","Data":"22ca47f296ded8cca4469925f46b0e23781b9a50b40e3c343473e7e1b514dffa"} Jun 08 12:05:45.043212 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:45.042980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:05:45.043212 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:45.043133 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:45.043212 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:05:45.043199 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:06:17.043180141 +0000 UTC m=+98.202608932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:05:47.628520 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:47.628435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57jf7" event={"ID":"d8d587e6-444d-4114-9ecc-fcb6e8e9e208","Type":"ContainerStarted","Data":"6869b0bba63ac9bb9e87125f16e354159748deb817f053b52f69c18e413d793e"} Jun 08 12:05:47.628897 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:47.628561 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:05:47.647021 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:47.646967 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-57jf7" podStartSLOduration=65.817386595 podStartE2EDuration="1m8.646948034s" totalImagesPullingTime="2.829561439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:47.646190373 +0000 UTC m=+68.805619190" watchObservedRunningTime="2026-06-08 12:05:47.646948034 +0000 UTC m=+68.806376850" Jun 08 12:05:49.634984 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:49.634950 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7swr" event={"ID":"c06b5b67-d121-4e4f-9fcc-9161f9f8defc","Type":"ContainerStarted","Data":"e5e2a966bfcf93abce6a43ff4f9f71a3fdd96029b770b6e289405f7c7b44f51f"} Jun 08 12:05:49.654691 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:05:49.654644 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v7swr" podStartSLOduration=66.118220816 podStartE2EDuration="1m10.654630719s" totalImagesPullingTime="4.536409903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:49.653820096 +0000 UTC m=+70.813248914" watchObservedRunningTime="2026-06-08 12:05:49.654630719 +0000 UTC m=+70.814059587" Jun 08 12:06:17.053403 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:06:17.053272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:06:17.053403 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:06:17.053393 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:06:17.053930 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:06:17.053478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:07:21.05345667 +0000 UTC m=+162.212885462 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:06:18.633455 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:06:18.633424 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-57jf7" Jun 08 12:06:48.146592 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:06:48.146545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:06:48.147065 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:06:48.146667 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:06:48.147065 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:06:48.146721 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs podName:86608abc-fc02-4953-be82-3342a1cc3cb5 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:50.146704787 +0000 UTC m=+251.306133579 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs") pod "network-metrics-daemon-mjdl2" (UID: "86608abc-fc02-4953-be82-3342a1cc3cb5") : secret "metrics-daemon-secret" not found Jun 08 12:07:16.217117 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:07:16.217060 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5x29n" podUID="5188f961-40a6-4f73-a72b-393c254a714c" Jun 08 12:07:16.342848 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:07:16.342809 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mjdl2" podUID="86608abc-fc02-4953-be82-3342a1cc3cb5" Jun 08 12:07:16.877658 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:07:16.877627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x29n" Jun 08 12:07:21.059216 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:07:21.059169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:07:21.059716 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:07:21.059327 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:07:21.059716 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:07:21.059401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls podName:5188f961-40a6-4f73-a72b-393c254a714c nodeName:}" failed. No retries permitted until 2026-06-08 12:09:23.059385148 +0000 UTC m=+284.218813940 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls") pod "dns-default-5x29n" (UID: "5188f961-40a6-4f73-a72b-393c254a714c") : secret "dns-default-metrics-tls" not found Jun 08 12:07:31.322359 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:07:31.322271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:08:13.094940 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.094908 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb"] Jun 08 12:08:13.096739 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.096723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.099481 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.099462 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 12:08:13.100341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.100329 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 12:08:13.100440 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.100347 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xl746\"" Jun 08 12:08:13.100440 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.100395 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 12:08:13.100440 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.100399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:08:13.116369 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.116347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb"] Jun 08 12:08:13.198259 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.198232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43cb440d-319b-4727-a540-4637bcc696f4-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.198356 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.198273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcz9\" (UniqueName: \"kubernetes.io/projected/43cb440d-319b-4727-a540-4637bcc696f4-kube-api-access-phcz9\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.198356 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.198299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43cb440d-319b-4727-a540-4637bcc696f4-config\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.298900 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.298866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43cb440d-319b-4727-a540-4637bcc696f4-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.299001 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.298915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcz9\" (UniqueName: \"kubernetes.io/projected/43cb440d-319b-4727-a540-4637bcc696f4-kube-api-access-phcz9\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.299001 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.298935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43cb440d-319b-4727-a540-4637bcc696f4-config\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.299433 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.299413 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43cb440d-319b-4727-a540-4637bcc696f4-config\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.301225 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.301201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43cb440d-319b-4727-a540-4637bcc696f4-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.307586 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.307562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcz9\" (UniqueName: \"kubernetes.io/projected/43cb440d-319b-4727-a540-4637bcc696f4-kube-api-access-phcz9\") pod \"service-ca-operator-6bc5ff68f5-m8wzb\" (UID: \"43cb440d-319b-4727-a540-4637bcc696f4\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.405227 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.405178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" Jun 08 12:08:13.525024 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:13.524999 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb"] Jun 08 12:08:14.034339 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:14.034299 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" event={"ID":"43cb440d-319b-4727-a540-4637bcc696f4","Type":"ContainerStarted","Data":"39c6929e51fa6d5bd653873872cc3fa2c6d1dfc0883ca1eb6d6945691b1eadc9"} Jun 08 12:08:16.041751 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:16.041718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" event={"ID":"43cb440d-319b-4727-a540-4637bcc696f4","Type":"ContainerStarted","Data":"fa110684f2ddff52fff6e3d3674d41da77e2e6b4f403290d4a3a7ef07c34bf12"} Jun 08 12:08:16.057788 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:16.057744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" podStartSLOduration=0.736630679 podStartE2EDuration="3.05773088s" totalImagesPullingTime="2.321100201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:16.056345161 +0000 UTC m=+217.215773976" watchObservedRunningTime="2026-06-08 12:08:16.05773088 +0000 UTC m=+217.217159684" Jun 08 12:08:18.400181 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:18.400151 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktzqj_03bef4ca-9b00-461d-9bc4-7994d49b7873/dns-node-resolver/0.log" Jun 08 12:08:19.600881 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:19.600852 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njjnk_ed1d36e8-776e-4c3a-8449-608ecf55edf9/node-ca/0.log" Jun 08 12:08:20.204681 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:20.204647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-grctn_6825ab2c-f39b-43b2-a676-cc2804c6d53a/serve-healthcheck-canary/0.log" Jun 08 12:08:40.353724 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.353698 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-smmnl"] Jun 08 12:08:40.356015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.356000 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.358834 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.358815 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:08:40.358931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.358896 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:08:40.359837 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.359813 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:08:40.360147 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.360124 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hq4d8\"" Jun 08 12:08:40.360212 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.360171 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:08:40.370082 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.370061 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smmnl"] Jun 08 12:08:40.427349 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.427329 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-689544c4b9-jlkzq"] Jun 08 12:08:40.429186 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.429172 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.432029 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.432003 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 12:08:40.432337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.432319 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gdkss\"" Jun 08 12:08:40.432337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.432333 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 12:08:40.432650 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.432625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 12:08:40.437781 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.437760 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 12:08:40.446383 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.446359 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689544c4b9-jlkzq"] Jun 08 12:08:40.483953 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.483925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2617dcf9-d4ff-49a5-b383-2bc2547111dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.484043 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.483962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.484043 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.483992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-tls\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484043 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-trusted-ca\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdxp\" (UniqueName: \"kubernetes.io/projected/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-api-access-kcdxp\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.484250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/579109ab-dfc3-46f1-be79-ae6ed7639e56-ca-trust-extracted\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwzl\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-kube-api-access-dlwzl\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-installation-pull-secrets\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-image-registry-private-configuration\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484464 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2617dcf9-d4ff-49a5-b383-2bc2547111dd-data-volume\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.484464 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2617dcf9-d4ff-49a5-b383-2bc2547111dd-crio-socket\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.484464 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-bound-sa-token\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.484464 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.484356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-certificates\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585501 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-tls\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585604 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-trusted-ca\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585604 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdxp\" (UniqueName: \"kubernetes.io/projected/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-api-access-kcdxp\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.585604 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/579109ab-dfc3-46f1-be79-ae6ed7639e56-ca-trust-extracted\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585604 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwzl\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-kube-api-access-dlwzl\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-installation-pull-secrets\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-image-registry-private-configuration\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2617dcf9-d4ff-49a5-b383-2bc2547111dd-data-volume\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.585951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2617dcf9-d4ff-49a5-b383-2bc2547111dd-crio-socket\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.585951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-bound-sa-token\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.585951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-certificates\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.586094 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2617dcf9-d4ff-49a5-b383-2bc2547111dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.586094 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.586094 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/579109ab-dfc3-46f1-be79-ae6ed7639e56-ca-trust-extracted\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.586292 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.585938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2617dcf9-d4ff-49a5-b383-2bc2547111dd-crio-socket\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.586292 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586228 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2617dcf9-d4ff-49a5-b383-2bc2547111dd-data-volume\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.586578 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-trusted-ca\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.586672 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586646 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.586894 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.586869 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-certificates\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.588266 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.588239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-registry-tls\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.588359 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.588242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-installation-pull-secrets\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.588417 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.588392 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2617dcf9-d4ff-49a5-b383-2bc2547111dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.588472 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.588439 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/579109ab-dfc3-46f1-be79-ae6ed7639e56-image-registry-private-configuration\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.600632 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.600612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwzl\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-kube-api-access-dlwzl\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.600735 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.600715 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/579109ab-dfc3-46f1-be79-ae6ed7639e56-bound-sa-token\") pod \"image-registry-689544c4b9-jlkzq\" (UID: \"579109ab-dfc3-46f1-be79-ae6ed7639e56\") " pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.600830 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.600813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdxp\" (UniqueName: \"kubernetes.io/projected/2617dcf9-d4ff-49a5-b383-2bc2547111dd-kube-api-access-kcdxp\") pod \"insights-runtime-extractor-smmnl\" (UID: \"2617dcf9-d4ff-49a5-b383-2bc2547111dd\") " pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.665033 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.664979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smmnl" Jun 08 12:08:40.738274 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.738244 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:40.788806 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.788690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smmnl"] Jun 08 12:08:40.865755 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:40.865724 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689544c4b9-jlkzq"] Jun 08 12:08:40.869328 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:08:40.869303 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579109ab_dfc3_46f1_be79_ae6ed7639e56.slice/crio-9f70c30a5ac0dfbe2c209597b5c144e9aba192a7a27453a60da81442f4883a3d WatchSource:0}: Error finding container 9f70c30a5ac0dfbe2c209597b5c144e9aba192a7a27453a60da81442f4883a3d: Status 404 returned error can't find the container with id 9f70c30a5ac0dfbe2c209597b5c144e9aba192a7a27453a60da81442f4883a3d Jun 08 12:08:41.113830 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.113793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" event={"ID":"579109ab-dfc3-46f1-be79-ae6ed7639e56","Type":"ContainerStarted","Data":"6d9b42e17cd1516cef73a7aaea9c2163f52fbf10e1cb245e67f343c92b3943f6"} Jun 08 12:08:41.114014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.113851 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" event={"ID":"579109ab-dfc3-46f1-be79-ae6ed7639e56","Type":"ContainerStarted","Data":"9f70c30a5ac0dfbe2c209597b5c144e9aba192a7a27453a60da81442f4883a3d"} Jun 08 12:08:41.114014 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.113914 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:08:41.115309 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.115264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smmnl" event={"ID":"2617dcf9-d4ff-49a5-b383-2bc2547111dd","Type":"ContainerStarted","Data":"9838fa94e59f6b65444c955102cd86d567394401117ed44bc48ffb660db037df"} Jun 08 12:08:41.115419 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.115336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smmnl" event={"ID":"2617dcf9-d4ff-49a5-b383-2bc2547111dd","Type":"ContainerStarted","Data":"d572618e8dc9268c5571e7f2f044b44c5916d73160a0898b8eb9daf0fcc3eac9"} Jun 08 12:08:41.134888 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:41.134838 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podStartSLOduration=1.1348265419999999 podStartE2EDuration="1.134826542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:41.134187059 +0000 UTC m=+242.293615892" watchObservedRunningTime="2026-06-08 12:08:41.134826542 +0000 UTC m=+242.294255334" Jun 08 12:08:42.120069 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:42.120030 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smmnl" event={"ID":"2617dcf9-d4ff-49a5-b383-2bc2547111dd","Type":"ContainerStarted","Data":"7820663aacf790e896c10ecd8f9448128cf775debb4953b4c1aa9ac05523436c"} Jun 08 12:08:44.128706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:44.128674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smmnl" event={"ID":"2617dcf9-d4ff-49a5-b383-2bc2547111dd","Type":"ContainerStarted","Data":"c88d2e8aa05f7edc6e863cc5fc494207391e26da34fc606417498046f6af63a0"} Jun 08 12:08:44.146773 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:44.146726 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-smmnl" podStartSLOduration=1.7705081470000001 podStartE2EDuration="4.146708629s" totalImagesPullingTime="2.376200482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:08:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:44.14583033 +0000 UTC m=+245.305259165" watchObservedRunningTime="2026-06-08 12:08:44.146708629 +0000 UTC m=+245.306137442" Jun 08 12:08:47.921718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:47.921671 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" podUID="788a8bf8-aaed-46a8-93eb-461f86358abc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:08:50.147275 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:50.147244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:08:50.149480 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:50.149462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86608abc-fc02-4953-be82-3342a1cc3cb5-metrics-certs\") pod \"network-metrics-daemon-mjdl2\" (UID: \"86608abc-fc02-4953-be82-3342a1cc3cb5\") " pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:08:50.226152 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:50.226130 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jxz55\"" Jun 08 12:08:50.233481 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:50.233467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjdl2" Jun 08 12:08:50.354858 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:50.354824 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mjdl2"] Jun 08 12:08:50.357661 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:08:50.357637 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86608abc_fc02_4953_be82_3342a1cc3cb5.slice/crio-cd06ca2054c198d599b3da0e73d7580d3615996edd27de608977801c26dc8396 WatchSource:0}: Error finding container cd06ca2054c198d599b3da0e73d7580d3615996edd27de608977801c26dc8396: Status 404 returned error can't find the container with id cd06ca2054c198d599b3da0e73d7580d3615996edd27de608977801c26dc8396 Jun 08 12:08:51.150962 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:51.150916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjdl2" event={"ID":"86608abc-fc02-4953-be82-3342a1cc3cb5","Type":"ContainerStarted","Data":"cd06ca2054c198d599b3da0e73d7580d3615996edd27de608977801c26dc8396"} Jun 08 12:08:52.156016 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:52.155982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjdl2" event={"ID":"86608abc-fc02-4953-be82-3342a1cc3cb5","Type":"ContainerStarted","Data":"ba2a2f8f156d21f7576fa4ef2d07a56e4f1a5213161dd3c6ccde3131d156ca20"} Jun 08 12:08:52.156414 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:52.156037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjdl2" event={"ID":"86608abc-fc02-4953-be82-3342a1cc3cb5","Type":"ContainerStarted","Data":"19555949e9ed62aec4dc19b39eb5ada54fe715828bf262156af4375b9c13ab8d"} Jun 08 12:08:52.171807 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:52.171756 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mjdl2" podStartSLOduration=252.245591381 podStartE2EDuration="4m13.171739029s" totalImagesPullingTime="926.147648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:52.17135858 +0000 UTC m=+253.330787417" watchObservedRunningTime="2026-06-08 12:08:52.171739029 +0000 UTC m=+253.331167842" Jun 08 12:08:55.079208 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.079174 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn"] Jun 08 12:08:55.082380 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.082362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.085665 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.085644 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:08:55.086678 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.086655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 12:08:55.086790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.086684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:08:55.086790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.086654 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cklbt\"" Jun 08 12:08:55.086790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.086705 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:08:55.086790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.086661 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 12:08:55.109764 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.109739 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn"] Jun 08 12:08:55.128919 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.128896 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rk84n"] Jun 08 12:08:55.131782 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.131767 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.135149 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.135124 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:08:55.135251 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.135232 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vncjq\"" Jun 08 12:08:55.135321 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.135266 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:08:55.135399 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.135382 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:08:55.184261 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f6fcc68-0129-496d-9ddc-1c7b02134eac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.184360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-tls\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-root\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.184485 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184485 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpdc\" (UniqueName: \"kubernetes.io/projected/7f6fcc68-0129-496d-9ddc-1c7b02134eac-kube-api-access-gdpdc\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.184485 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjjt\" (UniqueName: \"kubernetes.io/projected/506e7f70-72e7-44f4-918e-cf69bf84df70-kube-api-access-jsjjt\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184485 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-accelerators-collector-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-sys\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-wtmp\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.184648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-textfile\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.184648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.184633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-metrics-client-ca\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.285883 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.285853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-accelerators-collector-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.285981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.285890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-sys\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.285981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.285913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-wtmp\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.285981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.285964 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-sys\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.285996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-textfile\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-metrics-client-ca\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286053 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-wtmp\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f6fcc68-0129-496d-9ddc-1c7b02134eac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-tls\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-root\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpdc\" (UniqueName: \"kubernetes.io/projected/7f6fcc68-0129-496d-9ddc-1c7b02134eac-kube-api-access-gdpdc\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506e7f70-72e7-44f4-918e-cf69bf84df70-root\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjjt\" (UniqueName: \"kubernetes.io/projected/506e7f70-72e7-44f4-918e-cf69bf84df70-kube-api-access-jsjjt\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286325 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-textfile\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286430 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-accelerators-collector-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286847 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506e7f70-72e7-44f4-918e-cf69bf84df70-metrics-client-ca\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.286907 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.286844 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f6fcc68-0129-496d-9ddc-1c7b02134eac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.288523 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.288498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.288660 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.288643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f6fcc68-0129-496d-9ddc-1c7b02134eac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.288701 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.288649 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-tls\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.288760 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.288740 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506e7f70-72e7-44f4-918e-cf69bf84df70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.294158 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.294137 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjjt\" (UniqueName: \"kubernetes.io/projected/506e7f70-72e7-44f4-918e-cf69bf84df70-kube-api-access-jsjjt\") pod \"node-exporter-rk84n\" (UID: \"506e7f70-72e7-44f4-918e-cf69bf84df70\") " pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.294503 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.294484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpdc\" (UniqueName: \"kubernetes.io/projected/7f6fcc68-0129-496d-9ddc-1c7b02134eac-kube-api-access-gdpdc\") pod \"openshift-state-metrics-65f78d5c66-p4rwn\" (UID: \"7f6fcc68-0129-496d-9ddc-1c7b02134eac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.391609 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.391556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" Jun 08 12:08:55.440579 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.440353 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rk84n" Jun 08 12:08:55.451355 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:08:55.451310 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506e7f70_72e7_44f4_918e_cf69bf84df70.slice/crio-718705f81bbac5797b39111cbd57c7d7d6c2219336fcec264ccff16489e5dac1 WatchSource:0}: Error finding container 718705f81bbac5797b39111cbd57c7d7d6c2219336fcec264ccff16489e5dac1: Status 404 returned error can't find the container with id 718705f81bbac5797b39111cbd57c7d7d6c2219336fcec264ccff16489e5dac1 Jun 08 12:08:55.524862 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:55.524838 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn"] Jun 08 12:08:55.527549 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:08:55.527521 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6fcc68_0129_496d_9ddc_1c7b02134eac.slice/crio-4985710767d69235af19ab033deb2caedbfceed839a09f948024effb0b18ebbb WatchSource:0}: Error finding container 4985710767d69235af19ab033deb2caedbfceed839a09f948024effb0b18ebbb: Status 404 returned error can't find the container with id 4985710767d69235af19ab033deb2caedbfceed839a09f948024effb0b18ebbb Jun 08 12:08:56.157630 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.157598 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:08:56.161027 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.161003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.163827 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.163803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164069 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164356 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164446 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164642 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.164355 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xnkqz\"" Jun 08 12:08:56.167185 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.165034 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:08:56.172065 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.172039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rk84n" event={"ID":"506e7f70-72e7-44f4-918e-cf69bf84df70","Type":"ContainerStarted","Data":"718705f81bbac5797b39111cbd57c7d7d6c2219336fcec264ccff16489e5dac1"} Jun 08 12:08:56.174244 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.174217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" event={"ID":"7f6fcc68-0129-496d-9ddc-1c7b02134eac","Type":"ContainerStarted","Data":"06c662ba0a44aaa8c73e9a240cc13d9670501177f73d5faa3025d226eeae39e8"} Jun 08 12:08:56.174343 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.174277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" event={"ID":"7f6fcc68-0129-496d-9ddc-1c7b02134eac","Type":"ContainerStarted","Data":"672b1584c91ba8512f2688dc1984c869ce8405a01874826413ac49f2998a3f2e"} Jun 08 12:08:56.174343 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.174309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" event={"ID":"7f6fcc68-0129-496d-9ddc-1c7b02134eac","Type":"ContainerStarted","Data":"4985710767d69235af19ab033deb2caedbfceed839a09f948024effb0b18ebbb"} Jun 08 12:08:56.177469 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.177447 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:08:56.292646 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292929 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2m5k\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292929 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292929 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.292929 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.293119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.293119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.292966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.293119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.293006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.293119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.293051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.293119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.293082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394007 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.393959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m5k\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.394559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.394451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.396133 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.396087 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.397381 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.397360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.397749 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.397700 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.399903 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.399877 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400003 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.399937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400003 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.399955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400607 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.400583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400793 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.400752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400881 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.400805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.400881 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.400844 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.401200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.401182 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.401795 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.401771 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.405892 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.405869 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2m5k\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k\") pod \"alertmanager-main-0\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.475778 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.475753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:08:56.615933 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:56.615907 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:08:56.618689 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:08:56.618667 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a564bd_36ab_448f_b191_954c61b4bfff.slice/crio-f892119df88ac4f196f598545c1bf8f94f02a649689cea32df7408786511cf97 WatchSource:0}: Error finding container f892119df88ac4f196f598545c1bf8f94f02a649689cea32df7408786511cf97: Status 404 returned error can't find the container with id f892119df88ac4f196f598545c1bf8f94f02a649689cea32df7408786511cf97 Jun 08 12:08:57.179184 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.179154 2575 generic.go:356] "Generic (PLEG): container finished" podID="506e7f70-72e7-44f4-918e-cf69bf84df70" containerID="391fb0446bfe398cf278de975941bda9f90c971c4b36fdc769539b2e15fc9dc2" exitCode=0 Jun 08 12:08:57.179576 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.179243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rk84n" event={"ID":"506e7f70-72e7-44f4-918e-cf69bf84df70","Type":"ContainerDied","Data":"391fb0446bfe398cf278de975941bda9f90c971c4b36fdc769539b2e15fc9dc2"} Jun 08 12:08:57.180946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.180905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"f892119df88ac4f196f598545c1bf8f94f02a649689cea32df7408786511cf97"} Jun 08 12:08:57.183152 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.183038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" event={"ID":"7f6fcc68-0129-496d-9ddc-1c7b02134eac","Type":"ContainerStarted","Data":"391d0a8f924b790ba06a2a42de1b3a659fa7c9d83137ff5911a2a57e4771af5f"} Jun 08 12:08:57.222734 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.222685 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p4rwn" podStartSLOduration=0.824604954 podStartE2EDuration="2.222667342s" totalImagesPullingTime="1.398062388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:57.221806864 +0000 UTC m=+258.381235697" watchObservedRunningTime="2026-06-08 12:08:57.222667342 +0000 UTC m=+258.382096158" Jun 08 12:08:57.921138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:57.921088 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" podUID="788a8bf8-aaed-46a8-93eb-461f86358abc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:08:58.188761 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:58.188730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rk84n" event={"ID":"506e7f70-72e7-44f4-918e-cf69bf84df70","Type":"ContainerStarted","Data":"9e41d40c2b5e3544f8c8c809648fe31ca7decebd071308b53c62a044aaaf5bb7"} Jun 08 12:08:58.189144 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:58.188784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rk84n" event={"ID":"506e7f70-72e7-44f4-918e-cf69bf84df70","Type":"ContainerStarted","Data":"46e037be8ec64d0d885622c6a6047b186fc570033f59ea2bba40ca41e64b2e6e"} Jun 08 12:08:58.190311 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:58.190287 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0" exitCode=0 Jun 08 12:08:58.190397 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:58.190322 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0"} Jun 08 12:08:58.234326 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:08:58.234280 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rk84n" podStartSLOduration=2.102067575 podStartE2EDuration="3.234264286s" totalImagesPullingTime="1.066580045s" totalInitContainerRuntime="65.616666ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:58.207887813 +0000 UTC m=+259.367316627" watchObservedRunningTime="2026-06-08 12:08:58.234264286 +0000 UTC m=+259.393693176" Jun 08 12:09:00.742865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:00.742790 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:00.742865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:00.742840 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:01.206797 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:01.206762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66"} Jun 08 12:09:01.206952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:01.206837 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588"} Jun 08 12:09:01.206952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:01.206876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2"} Jun 08 12:09:01.206952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:01.206913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647"} Jun 08 12:09:01.206952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:01.206948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294"} Jun 08 12:09:02.123874 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:02.123843 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:02.124252 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:02.123887 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:02.213648 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:02.213617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerStarted","Data":"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037"} Jun 08 12:09:02.240577 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:02.240533 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.281492215 podStartE2EDuration="6.240519711s" totalImagesPullingTime="3.943365048s" totalInitContainerRuntime="15.662448ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:02.238647528 +0000 UTC m=+263.398076342" watchObservedRunningTime="2026-06-08 12:09:02.240519711 +0000 UTC m=+263.399948526" Jun 08 12:09:07.921209 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:07.921171 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" podUID="788a8bf8-aaed-46a8-93eb-461f86358abc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 12:09:07.921644 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:07.921249 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" Jun 08 12:09:07.921850 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:07.921815 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"49121dd2924beca8d43fa9ff052e36811e025e6cdca40f1faba30238e8c0bd11"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 12:09:07.921918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:07.921873 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" podUID="788a8bf8-aaed-46a8-93eb-461f86358abc" containerName="service-proxy" containerID="cri-o://49121dd2924beca8d43fa9ff052e36811e025e6cdca40f1faba30238e8c0bd11" gracePeriod=30 Jun 08 12:09:08.236443 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:08.236414 2575 generic.go:356] "Generic (PLEG): container finished" podID="788a8bf8-aaed-46a8-93eb-461f86358abc" containerID="49121dd2924beca8d43fa9ff052e36811e025e6cdca40f1faba30238e8c0bd11" exitCode=2 Jun 08 12:09:08.236549 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:08.236483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerDied","Data":"49121dd2924beca8d43fa9ff052e36811e025e6cdca40f1faba30238e8c0bd11"} Jun 08 12:09:08.236549 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:08.236522 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7999f54f8-gzkh6" event={"ID":"788a8bf8-aaed-46a8-93eb-461f86358abc","Type":"ContainerStarted","Data":"f6073a5ddc52c4be80ccbd50e09fca89cc1bafea8c408ddb31bb8c9474e9e01a"} Jun 08 12:09:10.742723 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:10.742694 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:10.743139 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:10.742740 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:12.124858 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:12.124824 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:12.125232 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:12.124882 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:19.878181 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:09:19.878138 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5x29n" podUID="5188f961-40a6-4f73-a72b-393c254a714c" Jun 08 12:09:20.280638 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.280612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:20.742761 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.742731 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:20.742932 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.742796 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:20.742932 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.742841 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:09:20.743346 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.743320 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"6d9b42e17cd1516cef73a7aaea9c2163f52fbf10e1cb245e67f343c92b3943f6"} pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" containerMessage="Container registry failed liveness probe, will be restarted" Jun 08 12:09:20.747558 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.747534 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:20.747672 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:20.747577 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:23.078119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.078066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:23.080776 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.080741 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5188f961-40a6-4f73-a72b-393c254a714c-metrics-tls\") pod \"dns-default-5x29n\" (UID: \"5188f961-40a6-4f73-a72b-393c254a714c\") " pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:23.283487 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.283456 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcszh\"" Jun 08 12:09:23.291603 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.291571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:23.420204 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.420176 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x29n"] Jun 08 12:09:23.423445 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:09:23.423419 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5188f961_40a6_4f73_a72b_393c254a714c.slice/crio-5b543fb9e17718e8227c35ece79bbc021915a28999752b4eda708c9179fcd58a WatchSource:0}: Error finding container 5b543fb9e17718e8227c35ece79bbc021915a28999752b4eda708c9179fcd58a: Status 404 returned error can't find the container with id 5b543fb9e17718e8227c35ece79bbc021915a28999752b4eda708c9179fcd58a Jun 08 12:09:23.726374 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:23.726349 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktzqj_03bef4ca-9b00-461d-9bc4-7994d49b7873/dns-node-resolver/0.log" Jun 08 12:09:24.296251 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:24.296217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x29n" event={"ID":"5188f961-40a6-4f73-a72b-393c254a714c","Type":"ContainerStarted","Data":"5b543fb9e17718e8227c35ece79bbc021915a28999752b4eda708c9179fcd58a"} Jun 08 12:09:24.327653 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:24.327630 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-689544c4b9-jlkzq_579109ab-dfc3-46f1-be79-ae6ed7639e56/registry/0.log" Jun 08 12:09:24.926756 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:24.926731 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njjnk_ed1d36e8-776e-4c3a-8449-608ecf55edf9/node-ca/0.log" Jun 08 12:09:25.527834 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:25.527809 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-grctn_6825ab2c-f39b-43b2-a676-cc2804c6d53a/serve-healthcheck-canary/0.log" Jun 08 12:09:26.307137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:26.307078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x29n" event={"ID":"5188f961-40a6-4f73-a72b-393c254a714c","Type":"ContainerStarted","Data":"fc256999e9e6c919154105adabc1adbe212a1713b73da2fe3f42f0a91c33b3da"} Jun 08 12:09:26.307288 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:26.307200 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x29n" event={"ID":"5188f961-40a6-4f73-a72b-393c254a714c","Type":"ContainerStarted","Data":"57c13a441b0b1f184e2522e88be12f4799b6575ca3e3e943ddc59f9bd3659730"} Jun 08 12:09:26.307288 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:26.307235 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:26.326253 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:26.326206 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5x29n" podStartSLOduration=251.455496654 podStartE2EDuration="4m13.326189031s" totalImagesPullingTime="1.870692377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:26.324336598 +0000 UTC m=+287.483765412" watchObservedRunningTime="2026-06-08 12:09:26.326189031 +0000 UTC m=+287.485617844" Jun 08 12:09:27.312038 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:27.312005 2575 generic.go:356] "Generic (PLEG): container finished" podID="43cb440d-319b-4727-a540-4637bcc696f4" containerID="fa110684f2ddff52fff6e3d3674d41da77e2e6b4f403290d4a3a7ef07c34bf12" exitCode=0 Jun 08 12:09:27.312429 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:27.312078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" event={"ID":"43cb440d-319b-4727-a540-4637bcc696f4","Type":"ContainerDied","Data":"fa110684f2ddff52fff6e3d3674d41da77e2e6b4f403290d4a3a7ef07c34bf12"} Jun 08 12:09:27.312466 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:27.312446 2575 scope.go:117] "RemoveContainer" containerID="fa110684f2ddff52fff6e3d3674d41da77e2e6b4f403290d4a3a7ef07c34bf12" Jun 08 12:09:28.318224 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:28.318183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m8wzb" event={"ID":"43cb440d-319b-4727-a540-4637bcc696f4","Type":"ContainerStarted","Data":"75ec84882eebe58494a80dafd92752b0331bd957a30ea746c010c5bcb6e348b1"} Jun 08 12:09:30.747061 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:30.747024 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:30.747426 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:30.747077 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:36.314699 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:36.314660 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5x29n" Jun 08 12:09:39.278217 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:39.278187 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:09:40.747476 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:40.747443 2575 patch_prober.go:28] interesting pod/image-registry-689544c4b9-jlkzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:40.748823 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:40.747491 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:45.762268 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:45.762222 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" podUID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerName="registry" containerID="cri-o://6d9b42e17cd1516cef73a7aaea9c2163f52fbf10e1cb245e67f343c92b3943f6" gracePeriod=30 Jun 08 12:09:47.394509 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:47.394476 2575 generic.go:356] "Generic (PLEG): container finished" podID="579109ab-dfc3-46f1-be79-ae6ed7639e56" containerID="6d9b42e17cd1516cef73a7aaea9c2163f52fbf10e1cb245e67f343c92b3943f6" exitCode=0 Jun 08 12:09:47.394949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:47.394572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" event={"ID":"579109ab-dfc3-46f1-be79-ae6ed7639e56","Type":"ContainerDied","Data":"6d9b42e17cd1516cef73a7aaea9c2163f52fbf10e1cb245e67f343c92b3943f6"} Jun 08 12:09:47.394949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:47.394621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" event={"ID":"579109ab-dfc3-46f1-be79-ae6ed7639e56","Type":"ContainerStarted","Data":"c94d3f1716a50768aa216132efdf31a0c6b57d9e094b31bd0c02e40fa3c1a6c9"} Jun 08 12:09:47.394949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:09:47.394648 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:10:08.403051 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:08.403014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-689544c4b9-jlkzq" Jun 08 12:10:15.456491 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456451 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456841 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="alertmanager" containerID="cri-o://2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" gracePeriod=120 Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456869 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-metric" containerID="cri-o://c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" gracePeriod=120 Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456869 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-web" containerID="cri-o://1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" gracePeriod=120 Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456909 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="prom-label-proxy" containerID="cri-o://beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" gracePeriod=120 Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456943 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="config-reloader" containerID="cri-o://44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" gracePeriod=120 Jun 08 12:10:15.457083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:15.456919 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy" containerID="cri-o://f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" gracePeriod=120 Jun 08 12:10:16.501805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501778 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" exitCode=0 Jun 08 12:10:16.501805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501800 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" exitCode=0 Jun 08 12:10:16.501805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501807 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" exitCode=0 Jun 08 12:10:16.501805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501813 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" exitCode=0 Jun 08 12:10:16.502282 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037"} Jun 08 12:10:16.502282 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501914 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588"} Jun 08 12:10:16.502282 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501944 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647"} Jun 08 12:10:16.502282 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.501970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294"} Jun 08 12:10:16.694722 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.694700 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:16.750703 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750677 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.750830 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750718 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2m5k\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.750830 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750756 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.750950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750872 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.750950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750919 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.750950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750944 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751133 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.750993 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751133 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751025 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751133 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751064 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751133 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751097 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751144 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751169 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751198 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets\") pod \"d7a564bd-36ab-448f-b191-954c61b4bfff\" (UID: \"d7a564bd-36ab-448f-b191-954c61b4bfff\") " Jun 08 12:10:16.751341 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751241 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:16.751542 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751446 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-metrics-client-ca\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.752622 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751868 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:16.752622 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.751972 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:10:16.753389 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.753348 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.753550 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.753515 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k" (OuterVolumeSpecName: "kube-api-access-j2m5k") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "kube-api-access-j2m5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:10:16.754739 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.754692 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.755015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.754930 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume" (OuterVolumeSpecName: "config-volume") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.755412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.755392 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out" (OuterVolumeSpecName: "config-out") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:10:16.755543 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.755518 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.756068 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.756043 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.756298 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.756281 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:10:16.758833 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.758815 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.764323 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.764303 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config" (OuterVolumeSpecName: "web-config") pod "d7a564bd-36ab-448f-b191-954c61b4bfff" (UID: "d7a564bd-36ab-448f-b191-954c61b4bfff"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:16.851717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851687 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-config-volume\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851717 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851728 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-config-out\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851737 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-main-db\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851747 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-cluster-tls-config\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851755 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-tls-assets\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851764 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851772 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2m5k\" (UniqueName: \"kubernetes.io/projected/d7a564bd-36ab-448f-b191-954c61b4bfff-kube-api-access-j2m5k\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851780 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-main-tls\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851789 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851797 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a564bd-36ab-448f-b191-954c61b4bfff-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:16.851861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:16.851806 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7a564bd-36ab-448f-b191-954c61b4bfff-web-config\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:10:17.509753 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509719 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" exitCode=0 Jun 08 12:10:17.509753 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509749 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerID="1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" exitCode=0 Jun 08 12:10:17.510201 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66"} Jun 08 12:10:17.510201 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509805 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.510201 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509862 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2"} Jun 08 12:10:17.510201 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7a564bd-36ab-448f-b191-954c61b4bfff","Type":"ContainerDied","Data":"f892119df88ac4f196f598545c1bf8f94f02a649689cea32df7408786511cf97"} Jun 08 12:10:17.510201 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.509960 2575 scope.go:117] "RemoveContainer" containerID="beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" Jun 08 12:10:17.526062 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.526044 2575 scope.go:117] "RemoveContainer" containerID="c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" Jun 08 12:10:17.532533 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.532518 2575 scope.go:117] "RemoveContainer" containerID="f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" Jun 08 12:10:17.532640 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.532621 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:17.537887 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.537868 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:17.539522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.539506 2575 scope.go:117] "RemoveContainer" containerID="1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" Jun 08 12:10:17.545752 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.545734 2575 scope.go:117] "RemoveContainer" containerID="44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" Jun 08 12:10:17.551975 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.551956 2575 scope.go:117] "RemoveContainer" containerID="2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" Jun 08 12:10:17.558864 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.558848 2575 scope.go:117] "RemoveContainer" containerID="17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0" Jun 08 12:10:17.564931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.564916 2575 scope.go:117] "RemoveContainer" containerID="beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" Jun 08 12:10:17.565281 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.565242 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037\": container with ID starting with beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037 not found: ID does not exist" containerID="beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" Jun 08 12:10:17.565281 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.565281 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037"} err="failed to get container status \"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037\": rpc error: code = NotFound desc = could not find container \"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037\": container with ID starting with beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037 not found: ID does not exist" Jun 08 12:10:17.565555 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.565306 2575 scope.go:117] "RemoveContainer" containerID="c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" Jun 08 12:10:17.565843 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.565625 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66\": container with ID starting with c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66 not found: ID does not exist" containerID="c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" Jun 08 12:10:17.565843 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.565654 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66"} err="failed to get container status \"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66\": rpc error: code = NotFound desc = could not find container \"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66\": container with ID starting with c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66 not found: ID does not exist" Jun 08 12:10:17.565843 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.565676 2575 scope.go:117] "RemoveContainer" containerID="f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" Jun 08 12:10:17.566118 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.566077 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588\": container with ID starting with f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588 not found: ID does not exist" containerID="f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" Jun 08 12:10:17.566226 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566117 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588"} err="failed to get container status \"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588\": rpc error: code = NotFound desc = could not find container \"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588\": container with ID starting with f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588 not found: ID does not exist" Jun 08 12:10:17.566226 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566134 2575 scope.go:117] "RemoveContainer" containerID="1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" Jun 08 12:10:17.566364 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.566350 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2\": container with ID starting with 1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2 not found: ID does not exist" containerID="1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" Jun 08 12:10:17.566407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566367 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2"} err="failed to get container status \"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2\": rpc error: code = NotFound desc = could not find container \"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2\": container with ID starting with 1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2 not found: ID does not exist" Jun 08 12:10:17.566407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566379 2575 scope.go:117] "RemoveContainer" containerID="44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" Jun 08 12:10:17.566659 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.566636 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647\": container with ID starting with 44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647 not found: ID does not exist" containerID="44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" Jun 08 12:10:17.566717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566668 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647"} err="failed to get container status \"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647\": rpc error: code = NotFound desc = could not find container \"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647\": container with ID starting with 44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647 not found: ID does not exist" Jun 08 12:10:17.566717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566689 2575 scope.go:117] "RemoveContainer" containerID="2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" Jun 08 12:10:17.566923 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.566902 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294\": container with ID starting with 2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294 not found: ID does not exist" containerID="2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" Jun 08 12:10:17.567000 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566925 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294"} err="failed to get container status \"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294\": rpc error: code = NotFound desc = could not find container \"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294\": container with ID starting with 2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294 not found: ID does not exist" Jun 08 12:10:17.567000 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.566942 2575 scope.go:117] "RemoveContainer" containerID="17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0" Jun 08 12:10:17.567119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567084 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:17.567174 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:10:17.567149 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0\": container with ID starting with 17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0 not found: ID does not exist" containerID="17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0" Jun 08 12:10:17.567217 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567172 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0"} err="failed to get container status \"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0\": rpc error: code = NotFound desc = could not find container \"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0\": container with ID starting with 17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0 not found: ID does not exist" Jun 08 12:10:17.567217 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567187 2575 scope.go:117] "RemoveContainer" containerID="beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037" Jun 08 12:10:17.567407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567387 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="prom-label-proxy" Jun 08 12:10:17.567407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567408 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="prom-label-proxy" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567409 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037"} err="failed to get container status \"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037\": rpc error: code = NotFound desc = could not find container \"beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037\": container with ID starting with beb4324c337f1fcf222b2c1b6f9310ce658e5e7656e3a10808b0b7b7c1795037 not found: ID does not exist" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567421 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="alertmanager" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567435 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="alertmanager" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567446 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="init-config-reloader" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567452 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="init-config-reloader" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567459 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="config-reloader" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567464 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="config-reloader" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567474 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-metric" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567479 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-metric" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567488 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-web" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567493 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-web" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567423 2575 scope.go:117] "RemoveContainer" containerID="c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567500 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy" Jun 08 12:10:17.567522 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567507 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567558 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="alertmanager" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567569 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="config-reloader" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567577 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-metric" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567588 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy-web" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567595 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="prom-label-proxy" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567601 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" containerName="kube-rbac-proxy" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567723 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66"} err="failed to get container status \"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66\": rpc error: code = NotFound desc = could not find container \"c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66\": container with ID starting with c2586e2c0627e5aede83add9eb96c4314b1a58091c8f38eaa83148acd9fa4f66 not found: ID does not exist" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567743 2575 scope.go:117] "RemoveContainer" containerID="f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567966 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588"} err="failed to get container status \"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588\": rpc error: code = NotFound desc = could not find container \"f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588\": container with ID starting with f67e57fe463bda0e1f3e0e797b8431508d19d43aeb17548d77e20dd7c3152588 not found: ID does not exist" Jun 08 12:10:17.568015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.567991 2575 scope.go:117] "RemoveContainer" containerID="1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2" Jun 08 12:10:17.568460 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568210 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2"} err="failed to get container status \"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2\": rpc error: code = NotFound desc = could not find container \"1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2\": container with ID starting with 1b9a0e0c54c2c2a2d4f40c07d4f183358f8c27fa6f15633b84d5c47adc7458c2 not found: ID does not exist" Jun 08 12:10:17.568460 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568223 2575 scope.go:117] "RemoveContainer" containerID="44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647" Jun 08 12:10:17.568460 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568427 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647"} err="failed to get container status \"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647\": rpc error: code = NotFound desc = could not find container \"44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647\": container with ID starting with 44a617c9881148e377cac2e5eaa319bf81a8155621700282faca563b5c120647 not found: ID does not exist" Jun 08 12:10:17.568460 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568438 2575 scope.go:117] "RemoveContainer" containerID="2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294" Jun 08 12:10:17.568667 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568647 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294"} err="failed to get container status \"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294\": rpc error: code = NotFound desc = could not find container \"2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294\": container with ID starting with 2712bbec664b6a5e8e674750bc855e3a46aeeba78cc9ef823605f05e1104c294 not found: ID does not exist" Jun 08 12:10:17.568707 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568668 2575 scope.go:117] "RemoveContainer" containerID="17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0" Jun 08 12:10:17.568901 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.568883 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0"} err="failed to get container status \"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0\": rpc error: code = NotFound desc = could not find container \"17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0\": container with ID starting with 17661fb9f6e51cf2eafd6c9dcba16ec5b2bb2a1a44125235a6794f8eca8169d0 not found: ID does not exist" Jun 08 12:10:17.570998 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.570983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.573411 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.573388 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:10:17.573508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.573388 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:10:17.573508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.573389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:10:17.573508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.573394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xnkqz\"" Jun 08 12:10:17.573668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.573656 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:10:17.574329 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.574312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:10:17.574412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.574381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:10:17.574644 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.574631 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:10:17.574688 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.574631 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:10:17.580969 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.580952 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:10:17.586465 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.586425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:17.657657 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdng\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-kube-api-access-8mdng\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-web-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-out\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.657918 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.658040 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.658040 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.658040 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.657968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.658040 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.658001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759072 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-web-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759072 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-out\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdng\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-kube-api-access-8mdng\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759489 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.759790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.759511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.761796 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.761770 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-out\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762386 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-web-config\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762441 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762679 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762742 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762847 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762803 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762904 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bc1bf6-582f-48b2-9c84-8941e66a787d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.762947 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.762934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.764023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.764003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6bc1bf6-582f-48b2-9c84-8941e66a787d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.771442 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.771405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdng\" (UniqueName: \"kubernetes.io/projected/a6bc1bf6-582f-48b2-9c84-8941e66a787d-kube-api-access-8mdng\") pod \"alertmanager-main-0\" (UID: \"a6bc1bf6-582f-48b2-9c84-8941e66a787d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:17.880271 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:17.880221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:10:18.018379 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:18.018340 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:10:18.022338 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:10:18.022308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bc1bf6_582f_48b2_9c84_8941e66a787d.slice/crio-8b00e414dc7a3bfd64363c1ad3c1e2e802269753702dcfc1633e83674dbd50fe WatchSource:0}: Error finding container 8b00e414dc7a3bfd64363c1ad3c1e2e802269753702dcfc1633e83674dbd50fe: Status 404 returned error can't find the container with id 8b00e414dc7a3bfd64363c1ad3c1e2e802269753702dcfc1633e83674dbd50fe Jun 08 12:10:18.520312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:18.520279 2575 generic.go:356] "Generic (PLEG): container finished" podID="a6bc1bf6-582f-48b2-9c84-8941e66a787d" containerID="ade0b29ce4b32e23f5c2eda1d589977708274dee60a92e1444b9768e5770d2d3" exitCode=0 Jun 08 12:10:18.520710 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:18.520346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerDied","Data":"ade0b29ce4b32e23f5c2eda1d589977708274dee60a92e1444b9768e5770d2d3"} Jun 08 12:10:18.520710 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:18.520445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"8b00e414dc7a3bfd64363c1ad3c1e2e802269753702dcfc1633e83674dbd50fe"} Jun 08 12:10:19.327336 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.327293 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a564bd-36ab-448f-b191-954c61b4bfff" path="/var/lib/kubelet/pods/d7a564bd-36ab-448f-b191-954c61b4bfff/volumes" Jun 08 12:10:19.526780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"311d989c51e15ffd737c69f394e7b5ec1bcee1618254f2012842f8bad2f527ed"} Jun 08 12:10:19.527138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"1d444b01ad5fc1a67094e83257e569db37e69ff29c85a82cc6949ab709d97625"} Jun 08 12:10:19.527138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"6ff9dd53defd8b28dce9a3827b5a37cb8330f274eabcfacc675a3209c258989a"} Jun 08 12:10:19.527138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526882 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"4d4c7258c1d4745c95110b59d2365f249d146159854e0bcb77791108db263d58"} Jun 08 12:10:19.527138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"62d699ef8664cfee1f3dbed53816843d999685f83196f7d47a60ad0af95e33af"} Jun 08 12:10:19.527138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.526935 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a6bc1bf6-582f-48b2-9c84-8941e66a787d","Type":"ContainerStarted","Data":"dbeb957bbe1d0f712c0913cdb3bed43b73c7604517cad84a8b69120cb4820ff3"} Jun 08 12:10:19.553773 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:10:19.553727 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5384835690000003 podStartE2EDuration="2.553712157s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.228588ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:19.552691509 +0000 UTC m=+340.712120338" watchObservedRunningTime="2026-06-08 12:10:19.553712157 +0000 UTC m=+340.713140970" Jun 08 12:11:09.171816 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.171782 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5"] Jun 08 12:11:09.174308 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.174293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.178292 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.178270 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:11:09.178292 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.178279 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:11:09.178437 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.178348 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:11:09.191213 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.191188 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5"] Jun 08 12:11:09.298664 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.298642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvc64\" (UniqueName: \"kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.298801 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.298673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.298801 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.298692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.399665 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.399633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvc64\" (UniqueName: \"kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.399783 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.399676 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.399783 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.399704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.399982 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.399961 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.400048 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.400035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.408983 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.408957 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvc64\" (UniqueName: \"kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.482822 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.482803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:09.608761 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.608734 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5"] Jun 08 12:11:09.611823 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:11:09.611791 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd508d25a_6085_4b85_97e0_714976c5b2ea.slice/crio-1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f WatchSource:0}: Error finding container 1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f: Status 404 returned error can't find the container with id 1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f Jun 08 12:11:09.613676 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.613656 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:11:09.707230 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:09.707194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" event={"ID":"d508d25a-6085-4b85-97e0-714976c5b2ea","Type":"ContainerStarted","Data":"1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f"} Jun 08 12:11:18.744737 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:18.744699 2575 generic.go:356] "Generic (PLEG): container finished" podID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerID="4238d2458ed6ec5450e0d06685fb72bdffa5831cd945a349e8971545b04c6239" exitCode=0 Jun 08 12:11:18.745159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:18.744742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" event={"ID":"d508d25a-6085-4b85-97e0-714976c5b2ea","Type":"ContainerDied","Data":"4238d2458ed6ec5450e0d06685fb72bdffa5831cd945a349e8971545b04c6239"} Jun 08 12:11:21.757738 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:21.757706 2575 generic.go:356] "Generic (PLEG): container finished" podID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerID="5627016f8f673894a0b115130d160c8085cd74caa1cda2f574f0cccf9b82ca8f" exitCode=0 Jun 08 12:11:21.758193 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:21.757760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" event={"ID":"d508d25a-6085-4b85-97e0-714976c5b2ea","Type":"ContainerDied","Data":"5627016f8f673894a0b115130d160c8085cd74caa1cda2f574f0cccf9b82ca8f"} Jun 08 12:11:31.795862 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:31.795795 2575 generic.go:356] "Generic (PLEG): container finished" podID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerID="18b40bbdde8a63fc0032e4d575c46aa11b3c375fb9b062a0b98e1e84b62e03a5" exitCode=0 Jun 08 12:11:31.796198 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:31.795877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" event={"ID":"d508d25a-6085-4b85-97e0-714976c5b2ea","Type":"ContainerDied","Data":"18b40bbdde8a63fc0032e4d575c46aa11b3c375fb9b062a0b98e1e84b62e03a5"} Jun 08 12:11:32.953588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:32.953567 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:33.065722 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.065671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util\") pod \"d508d25a-6085-4b85-97e0-714976c5b2ea\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " Jun 08 12:11:33.065722 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.065706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvc64\" (UniqueName: \"kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64\") pod \"d508d25a-6085-4b85-97e0-714976c5b2ea\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " Jun 08 12:11:33.065855 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.065740 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle\") pod \"d508d25a-6085-4b85-97e0-714976c5b2ea\" (UID: \"d508d25a-6085-4b85-97e0-714976c5b2ea\") " Jun 08 12:11:33.066483 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.066452 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle" (OuterVolumeSpecName: "bundle") pod "d508d25a-6085-4b85-97e0-714976c5b2ea" (UID: "d508d25a-6085-4b85-97e0-714976c5b2ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:11:33.067781 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.067754 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64" (OuterVolumeSpecName: "kube-api-access-kvc64") pod "d508d25a-6085-4b85-97e0-714976c5b2ea" (UID: "d508d25a-6085-4b85-97e0-714976c5b2ea"). InnerVolumeSpecName "kube-api-access-kvc64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:11:33.069980 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.069962 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util" (OuterVolumeSpecName: "util") pod "d508d25a-6085-4b85-97e0-714976c5b2ea" (UID: "d508d25a-6085-4b85-97e0-714976c5b2ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:11:33.166808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.166787 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:33.166808 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.166805 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d508d25a-6085-4b85-97e0-714976c5b2ea-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:33.166915 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.166813 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvc64\" (UniqueName: \"kubernetes.io/projected/d508d25a-6085-4b85-97e0-714976c5b2ea-kube-api-access-kvc64\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:33.804443 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.804423 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" Jun 08 12:11:33.804559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.804452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dshvz5" event={"ID":"d508d25a-6085-4b85-97e0-714976c5b2ea","Type":"ContainerDied","Data":"1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f"} Jun 08 12:11:33.804559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:33.804488 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1200588acf3394bff2fb45d14c90c3157da91b84ba03915e6da8873796c92f1f" Jun 08 12:11:42.034704 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034675 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk"] Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034937 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="util" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034949 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="util" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034958 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="pull" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034963 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="pull" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034974 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="extract" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.034979 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="extract" Jun 08 12:11:42.035170 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.035025 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d508d25a-6085-4b85-97e0-714976c5b2ea" containerName="extract" Jun 08 12:11:42.037291 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.037275 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.039843 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.039823 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:11:42.040875 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.040851 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:11:42.040970 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.040879 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:11:42.047508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.047490 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk"] Jun 08 12:11:42.224624 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.224601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn29c\" (UniqueName: \"kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.224717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.224638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.224717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.224698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.325617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.325566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.325617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.325600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn29c\" (UniqueName: \"kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.325777 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.325626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.325957 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.325938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.326016 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.325955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.333952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.333931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn29c\" (UniqueName: \"kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.345243 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.345226 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:42.468120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.468078 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk"] Jun 08 12:11:42.470703 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:11:42.470677 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79590385_897d_481c_a27e_63a418566ce7.slice/crio-0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0 WatchSource:0}: Error finding container 0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0: Status 404 returned error can't find the container with id 0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0 Jun 08 12:11:42.836926 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.836888 2575 generic.go:356] "Generic (PLEG): container finished" podID="79590385-897d-481c-a27e-63a418566ce7" containerID="f12b18f0bd08c2958cf22718d9d1f3e1ea33acb82d352d5ce350c82b58b21315" exitCode=0 Jun 08 12:11:42.837055 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.836964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" event={"ID":"79590385-897d-481c-a27e-63a418566ce7","Type":"ContainerDied","Data":"f12b18f0bd08c2958cf22718d9d1f3e1ea33acb82d352d5ce350c82b58b21315"} Jun 08 12:11:42.837055 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:42.837003 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" event={"ID":"79590385-897d-481c-a27e-63a418566ce7","Type":"ContainerStarted","Data":"0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0"} Jun 08 12:11:45.849508 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:45.849481 2575 generic.go:356] "Generic (PLEG): container finished" podID="79590385-897d-481c-a27e-63a418566ce7" containerID="f3d82834eec21386ddbbfd4c4d525455b3acce3297a38d85971b73453f57bf8c" exitCode=0 Jun 08 12:11:45.849897 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:45.849521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" event={"ID":"79590385-897d-481c-a27e-63a418566ce7","Type":"ContainerDied","Data":"f3d82834eec21386ddbbfd4c4d525455b3acce3297a38d85971b73453f57bf8c"} Jun 08 12:11:46.854947 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:46.854914 2575 generic.go:356] "Generic (PLEG): container finished" podID="79590385-897d-481c-a27e-63a418566ce7" containerID="c7b9823a1a3d921dc3b2b1c0bd29086726b0d5232f595082151f00af4568977b" exitCode=0 Jun 08 12:11:46.855327 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:46.854985 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" event={"ID":"79590385-897d-481c-a27e-63a418566ce7","Type":"ContainerDied","Data":"c7b9823a1a3d921dc3b2b1c0bd29086726b0d5232f595082151f00af4568977b"} Jun 08 12:11:47.977925 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:47.977903 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:48.065798 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.065764 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util\") pod \"79590385-897d-481c-a27e-63a418566ce7\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " Jun 08 12:11:48.065933 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.065859 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn29c\" (UniqueName: \"kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c\") pod \"79590385-897d-481c-a27e-63a418566ce7\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " Jun 08 12:11:48.065933 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.065906 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle\") pod \"79590385-897d-481c-a27e-63a418566ce7\" (UID: \"79590385-897d-481c-a27e-63a418566ce7\") " Jun 08 12:11:48.066418 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.066393 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle" (OuterVolumeSpecName: "bundle") pod "79590385-897d-481c-a27e-63a418566ce7" (UID: "79590385-897d-481c-a27e-63a418566ce7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:11:48.067937 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.067911 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c" (OuterVolumeSpecName: "kube-api-access-jn29c") pod "79590385-897d-481c-a27e-63a418566ce7" (UID: "79590385-897d-481c-a27e-63a418566ce7"). InnerVolumeSpecName "kube-api-access-jn29c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:11:48.072550 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.072523 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util" (OuterVolumeSpecName: "util") pod "79590385-897d-481c-a27e-63a418566ce7" (UID: "79590385-897d-481c-a27e-63a418566ce7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:11:48.166385 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.166331 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn29c\" (UniqueName: \"kubernetes.io/projected/79590385-897d-481c-a27e-63a418566ce7-kube-api-access-jn29c\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:48.166385 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.166359 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:48.166385 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.166368 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79590385-897d-481c-a27e-63a418566ce7-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:11:48.862603 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.862581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" event={"ID":"79590385-897d-481c-a27e-63a418566ce7","Type":"ContainerDied","Data":"0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0"} Jun 08 12:11:48.862714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.862623 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0804b8264b8fa40d54aceab95301b2351e24f9d5b7042bb39d5fd5f490259ca0" Jun 08 12:11:48.862714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:48.862589 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9b9hk" Jun 08 12:11:54.220118 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220070 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh"] Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220383 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="util" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220396 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="util" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220413 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="extract" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220420 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="extract" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220433 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="pull" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220440 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="pull" Jun 08 12:11:54.220511 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.220481 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="79590385-897d-481c-a27e-63a418566ce7" containerName="extract" Jun 08 12:11:54.222358 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.222341 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.228297 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.228271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tbkp4\"" Jun 08 12:11:54.229057 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.229040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 12:11:54.229210 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.229155 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:11:54.231427 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.231396 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh"] Jun 08 12:11:54.303470 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.303449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f342e10-72bc-41b4-a975-bb7fe5fa939b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.303573 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.303497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crw8g\" (UniqueName: \"kubernetes.io/projected/9f342e10-72bc-41b4-a975-bb7fe5fa939b-kube-api-access-crw8g\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.404578 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.404550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crw8g\" (UniqueName: \"kubernetes.io/projected/9f342e10-72bc-41b4-a975-bb7fe5fa939b-kube-api-access-crw8g\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.404703 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.404592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f342e10-72bc-41b4-a975-bb7fe5fa939b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.404888 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.404870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f342e10-72bc-41b4-a975-bb7fe5fa939b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.413915 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.413886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crw8g\" (UniqueName: \"kubernetes.io/projected/9f342e10-72bc-41b4-a975-bb7fe5fa939b-kube-api-access-crw8g\") pod \"openshift-lws-operator-fd8ccff4c-c24hh\" (UID: \"9f342e10-72bc-41b4-a975-bb7fe5fa939b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.538067 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.538016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" Jun 08 12:11:54.657061 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.657038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh"] Jun 08 12:11:54.659432 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:11:54.659405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f342e10_72bc_41b4_a975_bb7fe5fa939b.slice/crio-b322320504319df7f023313e3b64074392ab526053ad8f90470e629d891d1b22 WatchSource:0}: Error finding container b322320504319df7f023313e3b64074392ab526053ad8f90470e629d891d1b22: Status 404 returned error can't find the container with id b322320504319df7f023313e3b64074392ab526053ad8f90470e629d891d1b22 Jun 08 12:11:54.886756 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:54.886688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" event={"ID":"9f342e10-72bc-41b4-a975-bb7fe5fa939b","Type":"ContainerStarted","Data":"b322320504319df7f023313e3b64074392ab526053ad8f90470e629d891d1b22"} Jun 08 12:11:56.896183 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:56.896149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" event={"ID":"9f342e10-72bc-41b4-a975-bb7fe5fa939b","Type":"ContainerStarted","Data":"88aebadd2e0d8e7773a7069089942b2c17111de495c30667b6e782b57aca3af2"} Jun 08 12:11:56.917937 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:56.917888 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c24hh" podStartSLOduration=0.882263122 podStartE2EDuration="2.91787234s" totalImagesPullingTime="2.035609218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:11:56.917003288 +0000 UTC m=+438.076432102" watchObservedRunningTime="2026-06-08 12:11:56.91787234 +0000 UTC m=+438.077301157" Jun 08 12:11:59.893161 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.893070 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694"] Jun 08 12:11:59.895392 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.895376 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:11:59.898001 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.897975 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:11:59.898145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.898116 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:11:59.899082 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.899065 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:11:59.904002 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.903982 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694"] Jun 08 12:11:59.946145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.946122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:11:59.946236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.946165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85z8\" (UniqueName: \"kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:11:59.946236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:11:59.946223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.047378 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.047356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.047494 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.047396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85z8\" (UniqueName: \"kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.047494 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.047424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.047760 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.047743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.047796 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.047772 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.056173 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.056153 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85z8\" (UniqueName: \"kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.204523 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.204490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:00.329832 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.329809 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694"] Jun 08 12:12:00.332031 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:00.331995 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11254b4b_abbf_4cf7_a0ba_42d4983ea73d.slice/crio-9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2 WatchSource:0}: Error finding container 9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2: Status 404 returned error can't find the container with id 9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2 Jun 08 12:12:00.911299 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.911262 2575 generic.go:356] "Generic (PLEG): container finished" podID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerID="bb1f2eaf33926a59410a5bd7fcd7efbbd623721fa27d61f19daa5ed2e4f134fd" exitCode=0 Jun 08 12:12:00.911666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.911357 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" event={"ID":"11254b4b-abbf-4cf7-a0ba-42d4983ea73d","Type":"ContainerDied","Data":"bb1f2eaf33926a59410a5bd7fcd7efbbd623721fa27d61f19daa5ed2e4f134fd"} Jun 08 12:12:00.911666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:00.911425 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" event={"ID":"11254b4b-abbf-4cf7-a0ba-42d4983ea73d","Type":"ContainerStarted","Data":"9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2"} Jun 08 12:12:02.921109 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:02.921081 2575 generic.go:356] "Generic (PLEG): container finished" podID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerID="b5f88ce85d37f6e24a1295114841b94a14a4e6f2547fd5e795a17444610c6b68" exitCode=0 Jun 08 12:12:02.921493 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:02.921170 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" event={"ID":"11254b4b-abbf-4cf7-a0ba-42d4983ea73d","Type":"ContainerDied","Data":"b5f88ce85d37f6e24a1295114841b94a14a4e6f2547fd5e795a17444610c6b68"} Jun 08 12:12:03.930134 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:03.930088 2575 generic.go:356] "Generic (PLEG): container finished" podID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerID="44e592f02d2895b1239dbddd06401858ba7a2740abc6956f5961decb2e468ba9" exitCode=0 Jun 08 12:12:03.930545 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:03.930134 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" event={"ID":"11254b4b-abbf-4cf7-a0ba-42d4983ea73d","Type":"ContainerDied","Data":"44e592f02d2895b1239dbddd06401858ba7a2740abc6956f5961decb2e468ba9"} Jun 08 12:12:05.051478 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.051456 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:05.084119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.084080 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w85z8\" (UniqueName: \"kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8\") pod \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " Jun 08 12:12:05.084224 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.084155 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util\") pod \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " Jun 08 12:12:05.084224 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.084203 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle\") pod \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\" (UID: \"11254b4b-abbf-4cf7-a0ba-42d4983ea73d\") " Jun 08 12:12:05.084872 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.084848 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle" (OuterVolumeSpecName: "bundle") pod "11254b4b-abbf-4cf7-a0ba-42d4983ea73d" (UID: "11254b4b-abbf-4cf7-a0ba-42d4983ea73d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:12:05.086077 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.086051 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8" (OuterVolumeSpecName: "kube-api-access-w85z8") pod "11254b4b-abbf-4cf7-a0ba-42d4983ea73d" (UID: "11254b4b-abbf-4cf7-a0ba-42d4983ea73d"). InnerVolumeSpecName "kube-api-access-w85z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:12:05.089419 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.089399 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util" (OuterVolumeSpecName: "util") pod "11254b4b-abbf-4cf7-a0ba-42d4983ea73d" (UID: "11254b4b-abbf-4cf7-a0ba-42d4983ea73d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:12:05.184999 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.184962 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:05.184999 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.184995 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w85z8\" (UniqueName: \"kubernetes.io/projected/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-kube-api-access-w85z8\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:05.184999 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.185005 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11254b4b-abbf-4cf7-a0ba-42d4983ea73d-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:05.940247 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.940212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" event={"ID":"11254b4b-abbf-4cf7-a0ba-42d4983ea73d","Type":"ContainerDied","Data":"9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2"} Jun 08 12:12:05.940414 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.940260 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bf26fdcd9b56df8548476a47c52c1711afb5686a4d3427689a5f9a167c4d0c2" Jun 08 12:12:05.940414 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:05.940227 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2j694" Jun 08 12:12:22.500494 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500461 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j"] Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500709 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="pull" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500719 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="pull" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500734 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="util" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500739 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="util" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500758 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="extract" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500763 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="extract" Jun 08 12:12:22.500877 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.500806 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="11254b4b-abbf-4cf7-a0ba-42d4983ea73d" containerName="extract" Jun 08 12:12:22.507833 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.507807 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.510731 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.510706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:12:22.510898 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.510882 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzhzf\"" Jun 08 12:12:22.511143 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.511125 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:12:22.511298 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.511157 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:12:22.513879 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.513860 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:12:22.525420 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.525394 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j"] Jun 08 12:12:22.616129 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.616075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.616301 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.616136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.616301 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.616201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9br4\" (UniqueName: \"kubernetes.io/projected/add7ae8b-58e4-45f1-8c3c-900d44aa9668-kube-api-access-g9br4\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.616301 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.616223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.616301 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.616254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.717649 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.717613 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.717649 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.717652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.717861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.717686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9br4\" (UniqueName: \"kubernetes.io/projected/add7ae8b-58e4-45f1-8c3c-900d44aa9668-kube-api-access-g9br4\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.717861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.717708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.717861 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.717738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.718188 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.718152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.719971 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.719942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add7ae8b-58e4-45f1-8c3c-900d44aa9668-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.720251 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.720232 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.720329 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.720274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/add7ae8b-58e4-45f1-8c3c-900d44aa9668-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.730506 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.730485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9br4\" (UniqueName: \"kubernetes.io/projected/add7ae8b-58e4-45f1-8c3c-900d44aa9668-kube-api-access-g9br4\") pod \"opendatahub-operator-controller-manager-854df88b87-sqj8j\" (UID: \"add7ae8b-58e4-45f1-8c3c-900d44aa9668\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.818296 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.818207 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:22.954571 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:22.954539 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j"] Jun 08 12:12:22.956470 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:22.956444 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd7ae8b_58e4_45f1_8c3c_900d44aa9668.slice/crio-53167914c34d8904fac2d0b2be76089f837224d4afb76f7a8d87327b9b863758 WatchSource:0}: Error finding container 53167914c34d8904fac2d0b2be76089f837224d4afb76f7a8d87327b9b863758: Status 404 returned error can't find the container with id 53167914c34d8904fac2d0b2be76089f837224d4afb76f7a8d87327b9b863758 Jun 08 12:12:23.010968 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:23.010928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" event={"ID":"add7ae8b-58e4-45f1-8c3c-900d44aa9668","Type":"ContainerStarted","Data":"53167914c34d8904fac2d0b2be76089f837224d4afb76f7a8d87327b9b863758"} Jun 08 12:12:26.026065 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:26.025985 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" event={"ID":"add7ae8b-58e4-45f1-8c3c-900d44aa9668","Type":"ContainerStarted","Data":"8b0ebf22c51bd1e12aed79ff99c0930f0d09e4ec0cb0ca60463e326dcf150d38"} Jun 08 12:12:27.030938 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:27.030874 2575 generic.go:356] "Generic (PLEG): container finished" podID="add7ae8b-58e4-45f1-8c3c-900d44aa9668" containerID="8b0ebf22c51bd1e12aed79ff99c0930f0d09e4ec0cb0ca60463e326dcf150d38" exitCode=0 Jun 08 12:12:27.030938 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:27.030922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" event={"ID":"add7ae8b-58e4-45f1-8c3c-900d44aa9668","Type":"ContainerDied","Data":"8b0ebf22c51bd1e12aed79ff99c0930f0d09e4ec0cb0ca60463e326dcf150d38"} Jun 08 12:12:28.037534 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:28.037498 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" event={"ID":"add7ae8b-58e4-45f1-8c3c-900d44aa9668","Type":"ContainerStarted","Data":"acf6162799470222b7909dc72fa00c2d5b3643bc4fe13e4402bdf72012a0a11c"} Jun 08 12:12:28.037898 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:28.037609 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:28.066528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:28.066485 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" podStartSLOduration=2.051664844 podStartE2EDuration="6.066471877s" totalImagesPullingTime="3.084477806s" totalInitContainerRuntime="930.329227ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:28.064254384 +0000 UTC m=+469.223683200" watchObservedRunningTime="2026-06-08 12:12:28.066471877 +0000 UTC m=+469.225900746" Jun 08 12:12:39.043936 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:39.043901 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-sqj8j" Jun 08 12:12:42.156922 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.156883 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps"] Jun 08 12:12:42.165273 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.165253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.171323 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.171299 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:12:42.171453 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.171359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 12:12:42.171453 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.171367 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jh8vp\"" Jun 08 12:12:42.172404 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.172389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 12:12:42.172490 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.172396 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:12:42.174666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.174642 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-grkvf"] Jun 08 12:12:42.177669 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.177652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps"] Jun 08 12:12:42.177747 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.177734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.184155 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.184138 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qqgr7\"" Jun 08 12:12:42.184155 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.184148 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 12:12:42.197849 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.197812 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-grkvf"] Jun 08 12:12:42.253913 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.253879 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42"] Jun 08 12:12:42.257164 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.257148 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.260291 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.260274 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:12:42.261085 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.261179 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tls-certs\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.261179 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrj2\" (UniqueName: \"kubernetes.io/projected/ff6048d9-4d14-4434-8bce-8f0ecb23949b-kube-api-access-zmrj2\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.261279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwq2m\" (UniqueName: \"kubernetes.io/projected/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-kube-api-access-gwq2m\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.261331 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tmp\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.261906 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261886 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:12:42.261959 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.261941 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:12:42.277154 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.277127 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42"] Jun 08 12:12:42.362611 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tls-certs\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrj2\" (UniqueName: \"kubernetes.io/projected/ff6048d9-4d14-4434-8bce-8f0ecb23949b-kube-api-access-zmrj2\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwq2m\" (UniqueName: \"kubernetes.io/projected/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-kube-api-access-gwq2m\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:12:42.362728 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 12:12:42.362774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccsn7\" (UniqueName: \"kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.363059 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tmp\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.363059 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:12:42.362811 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert podName:a05034ab-a0d2-4a4d-a02d-a1f81e11efdf nodeName:}" failed. No retries permitted until 2026-06-08 12:12:42.862788448 +0000 UTC m=+484.022217240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert") pod "odh-model-controller-6dc94f689f-grkvf" (UID: "a05034ab-a0d2-4a4d-a02d-a1f81e11efdf") : secret "odh-model-controller-webhook-cert" not found Jun 08 12:12:42.363059 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.362894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.364938 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.364916 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tmp\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.365178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.365160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6048d9-4d14-4434-8bce-8f0ecb23949b-tls-certs\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.375846 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.375820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwq2m\" (UniqueName: \"kubernetes.io/projected/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-kube-api-access-gwq2m\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.377019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.377001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrj2\" (UniqueName: \"kubernetes.io/projected/ff6048d9-4d14-4434-8bce-8f0ecb23949b-kube-api-access-zmrj2\") pod \"kube-auth-proxy-54b6f995bf-v46ps\" (UID: \"ff6048d9-4d14-4434-8bce-8f0ecb23949b\") " pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.463774 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.463742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.463949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.463787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccsn7\" (UniqueName: \"kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.463949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.463815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.464168 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.464148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.464246 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.464177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.472421 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.472394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccsn7\" (UniqueName: \"kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.475224 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.475205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" Jun 08 12:12:42.566653 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.566626 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:42.612674 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.612599 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps"] Jun 08 12:12:42.614261 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:42.614223 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6048d9_4d14_4434_8bce_8f0ecb23949b.slice/crio-3034e55a03439b9e41a3b2d2b31b139e63272c1d297d68aa9611af2d97f35a7b WatchSource:0}: Error finding container 3034e55a03439b9e41a3b2d2b31b139e63272c1d297d68aa9611af2d97f35a7b: Status 404 returned error can't find the container with id 3034e55a03439b9e41a3b2d2b31b139e63272c1d297d68aa9611af2d97f35a7b Jun 08 12:12:42.717548 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.717521 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42"] Jun 08 12:12:42.719953 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:42.719924 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67e551e_3751_4eff_b89f_603ccb5fa324.slice/crio-2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de WatchSource:0}: Error finding container 2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de: Status 404 returned error can't find the container with id 2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de Jun 08 12:12:42.869721 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.869693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:42.871954 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:42.871934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05034ab-a0d2-4a4d-a02d-a1f81e11efdf-cert\") pod \"odh-model-controller-6dc94f689f-grkvf\" (UID: \"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf\") " pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:43.087482 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.087390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:43.103744 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.103712 2575 generic.go:356] "Generic (PLEG): container finished" podID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerID="8cfd7c4ba234d31480642ba1b3dd38fd741eb04bc729bbc3dbdd8aefa481f1ff" exitCode=0 Jun 08 12:12:43.103899 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.103791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerDied","Data":"8cfd7c4ba234d31480642ba1b3dd38fd741eb04bc729bbc3dbdd8aefa481f1ff"} Jun 08 12:12:43.103899 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.103844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerStarted","Data":"2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de"} Jun 08 12:12:43.105143 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.105121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" event={"ID":"ff6048d9-4d14-4434-8bce-8f0ecb23949b","Type":"ContainerStarted","Data":"3034e55a03439b9e41a3b2d2b31b139e63272c1d297d68aa9611af2d97f35a7b"} Jun 08 12:12:43.218525 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:43.218350 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-grkvf"] Jun 08 12:12:43.221191 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:43.221160 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05034ab_a0d2_4a4d_a02d_a1f81e11efdf.slice/crio-47a62c393b1241ca9b54e84783f5db89111d02c0bf55f196c14b497af868deac WatchSource:0}: Error finding container 47a62c393b1241ca9b54e84783f5db89111d02c0bf55f196c14b497af868deac: Status 404 returned error can't find the container with id 47a62c393b1241ca9b54e84783f5db89111d02c0bf55f196c14b497af868deac Jun 08 12:12:44.117066 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:44.116211 2575 generic.go:356] "Generic (PLEG): container finished" podID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerID="f4bdf9e16b0b9b9685441d6d3aa897fb65551816acd118f672d89fdc20358cc4" exitCode=0 Jun 08 12:12:44.117066 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:44.116830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerDied","Data":"f4bdf9e16b0b9b9685441d6d3aa897fb65551816acd118f672d89fdc20358cc4"} Jun 08 12:12:44.120231 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:44.120207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" event={"ID":"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf","Type":"ContainerStarted","Data":"47a62c393b1241ca9b54e84783f5db89111d02c0bf55f196c14b497af868deac"} Jun 08 12:12:45.129880 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:45.129809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerStarted","Data":"ca365b854dcd2b93234951545e760a66011169ef8b9380c31c38d1c5280591cc"} Jun 08 12:12:45.148811 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:45.148742 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" podStartSLOduration=2.322414794 podStartE2EDuration="3.148720359s" totalImagesPullingTime="826.305565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:45.148408594 +0000 UTC m=+486.307837442" watchObservedRunningTime="2026-06-08 12:12:45.148720359 +0000 UTC m=+486.308149199" Jun 08 12:12:46.137709 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:46.137672 2575 generic.go:356] "Generic (PLEG): container finished" podID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerID="ca365b854dcd2b93234951545e760a66011169ef8b9380c31c38d1c5280591cc" exitCode=0 Jun 08 12:12:46.138181 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:46.137755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerDied","Data":"ca365b854dcd2b93234951545e760a66011169ef8b9380c31c38d1c5280591cc"} Jun 08 12:12:47.291486 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.291462 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:47.411876 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.411784 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util\") pod \"b67e551e-3751-4eff-b89f-603ccb5fa324\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " Jun 08 12:12:47.412045 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.411894 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle\") pod \"b67e551e-3751-4eff-b89f-603ccb5fa324\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " Jun 08 12:12:47.412045 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.411925 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccsn7\" (UniqueName: \"kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7\") pod \"b67e551e-3751-4eff-b89f-603ccb5fa324\" (UID: \"b67e551e-3751-4eff-b89f-603ccb5fa324\") " Jun 08 12:12:47.412898 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.412866 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle" (OuterVolumeSpecName: "bundle") pod "b67e551e-3751-4eff-b89f-603ccb5fa324" (UID: "b67e551e-3751-4eff-b89f-603ccb5fa324"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:12:47.414158 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.414133 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7" (OuterVolumeSpecName: "kube-api-access-ccsn7") pod "b67e551e-3751-4eff-b89f-603ccb5fa324" (UID: "b67e551e-3751-4eff-b89f-603ccb5fa324"). InnerVolumeSpecName "kube-api-access-ccsn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:12:47.416901 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.416880 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util" (OuterVolumeSpecName: "util") pod "b67e551e-3751-4eff-b89f-603ccb5fa324" (UID: "b67e551e-3751-4eff-b89f-603ccb5fa324"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:12:47.513350 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.513314 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:47.513350 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.513351 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccsn7\" (UniqueName: \"kubernetes.io/projected/b67e551e-3751-4eff-b89f-603ccb5fa324-kube-api-access-ccsn7\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:47.513582 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:47.513367 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b67e551e-3751-4eff-b89f-603ccb5fa324-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:12:48.148789 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.148752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" event={"ID":"a05034ab-a0d2-4a4d-a02d-a1f81e11efdf","Type":"ContainerStarted","Data":"c9bb8b838d728d41bd1fa8004a240ad1b0c45c249f314f9e40122e05bc64bcfa"} Jun 08 12:12:48.148976 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.148817 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:48.150561 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.150533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" event={"ID":"b67e551e-3751-4eff-b89f-603ccb5fa324","Type":"ContainerDied","Data":"2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de"} Jun 08 12:12:48.150698 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.150576 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ba7855e10fea5ab3e94f748021206295ada08fa55a50349178c5ba40b0295de" Jun 08 12:12:48.150698 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.150541 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065vr42" Jun 08 12:12:48.151923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.151898 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" event={"ID":"ff6048d9-4d14-4434-8bce-8f0ecb23949b","Type":"ContainerStarted","Data":"165338cfbce2945d8b79f82b111519be525312dee18bda8b4868311b71c9554c"} Jun 08 12:12:48.165567 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.165528 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" podStartSLOduration=2.248196613 podStartE2EDuration="6.165512789s" totalImagesPullingTime="3.917316176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:48.164601356 +0000 UTC m=+489.324030194" watchObservedRunningTime="2026-06-08 12:12:48.165512789 +0000 UTC m=+489.324941581" Jun 08 12:12:48.185274 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:48.185232 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54b6f995bf-v46ps" podStartSLOduration=1.649044805 podStartE2EDuration="6.185218169s" totalImagesPullingTime="4.536173364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:48.184967957 +0000 UTC m=+489.344396787" watchObservedRunningTime="2026-06-08 12:12:48.185218169 +0000 UTC m=+489.344646983" Jun 08 12:12:50.397582 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.397549 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t"] Jun 08 12:12:50.397955 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.397939 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="pull" Jun 08 12:12:50.398008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.397960 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="pull" Jun 08 12:12:50.398008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.397975 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="extract" Jun 08 12:12:50.398008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.397984 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="extract" Jun 08 12:12:50.398008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.398003 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="util" Jun 08 12:12:50.398154 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.398014 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="util" Jun 08 12:12:50.398154 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.398084 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b67e551e-3751-4eff-b89f-603ccb5fa324" containerName="extract" Jun 08 12:12:50.401482 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.401466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.406408 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.406384 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 12:12:50.406408 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.406398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 12:12:50.406408 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.406403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 12:12:50.406635 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.406463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ncxrn\"" Jun 08 12:12:50.413432 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.413413 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t"] Jun 08 12:12:50.538199 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.538167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.538333 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.538228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvff4\" (UniqueName: \"kubernetes.io/projected/3a3678b8-acab-4ace-b330-258108546ea0-kube-api-access-vvff4\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.538333 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.538298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a3678b8-acab-4ace-b330-258108546ea0-manager-config\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.538424 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.538348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-metrics-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.639776 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.639718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-metrics-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.639931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.639809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.639931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.639861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvff4\" (UniqueName: \"kubernetes.io/projected/3a3678b8-acab-4ace-b330-258108546ea0-kube-api-access-vvff4\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.639931 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.639911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a3678b8-acab-4ace-b330-258108546ea0-manager-config\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.640659 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.640631 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a3678b8-acab-4ace-b330-258108546ea0-manager-config\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.642271 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.642244 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.642374 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.642273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a3678b8-acab-4ace-b330-258108546ea0-metrics-cert\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.649177 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.649124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvff4\" (UniqueName: \"kubernetes.io/projected/3a3678b8-acab-4ace-b330-258108546ea0-kube-api-access-vvff4\") pod \"lws-controller-manager-59f754cb69-ldg5t\" (UID: \"3a3678b8-acab-4ace-b330-258108546ea0\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.710369 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.710341 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:50.838730 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:50.838707 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t"] Jun 08 12:12:50.841227 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:50.841202 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3678b8_acab_4ace_b330_258108546ea0.slice/crio-2221ac5494f26318d43ef59a1d68ab08957490875069372cbfc10e2280b30df8 WatchSource:0}: Error finding container 2221ac5494f26318d43ef59a1d68ab08957490875069372cbfc10e2280b30df8: Status 404 returned error can't find the container with id 2221ac5494f26318d43ef59a1d68ab08957490875069372cbfc10e2280b30df8 Jun 08 12:12:51.167487 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:51.167460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" event={"ID":"3a3678b8-acab-4ace-b330-258108546ea0","Type":"ContainerStarted","Data":"2221ac5494f26318d43ef59a1d68ab08957490875069372cbfc10e2280b30df8"} Jun 08 12:12:53.178557 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:53.178524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" event={"ID":"3a3678b8-acab-4ace-b330-258108546ea0","Type":"ContainerStarted","Data":"d0622f617d46215753b466ef68dc71313c5c1463340267f016815e6bdd67f8c1"} Jun 08 12:12:53.178928 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:53.178620 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:12:53.203946 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:53.203902 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" podStartSLOduration=1.609591164 podStartE2EDuration="3.20389043s" totalImagesPullingTime="1.594299266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:53.203214775 +0000 UTC m=+494.362643611" watchObservedRunningTime="2026-06-08 12:12:53.20389043 +0000 UTC m=+494.363319243" Jun 08 12:12:56.865462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.865427 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l"] Jun 08 12:12:56.875096 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.875072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.881412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.881204 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:12:56.881412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.881313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:12:56.882301 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.882280 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:12:56.893244 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.893222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.893320 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.893247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.893320 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.893270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzsf\" (UniqueName: \"kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.914163 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.914142 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l"] Jun 08 12:12:56.994029 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.994002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.994192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.994035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.994192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.994070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzsf\" (UniqueName: \"kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.994472 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.994438 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:56.994611 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:56.994489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:57.020689 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:57.020662 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzsf\" (UniqueName: \"kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:57.184527 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:57.184500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:12:57.382602 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:57.382576 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l"] Jun 08 12:12:57.384519 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:12:57.384483 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5384ac_c378_416d_b33f_f063cb8ec541.slice/crio-952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d WatchSource:0}: Error finding container 952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d: Status 404 returned error can't find the container with id 952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d Jun 08 12:12:58.201559 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:58.201526 2575 generic.go:356] "Generic (PLEG): container finished" podID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerID="24ede7285fd5fe9e7942e064f99501f8612d53dd2cf9c5ed07b8e043db62ba1b" exitCode=0 Jun 08 12:12:58.201895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:58.201589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" event={"ID":"ba5384ac-c378-416d-b33f-f063cb8ec541","Type":"ContainerDied","Data":"24ede7285fd5fe9e7942e064f99501f8612d53dd2cf9c5ed07b8e043db62ba1b"} Jun 08 12:12:58.201895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:58.201633 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" event={"ID":"ba5384ac-c378-416d-b33f-f063cb8ec541","Type":"ContainerStarted","Data":"952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d"} Jun 08 12:12:59.158975 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:59.158908 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-grkvf" Jun 08 12:12:59.208632 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:59.208602 2575 generic.go:356] "Generic (PLEG): container finished" podID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerID="d4b1f8badfff2d48747ff95a32f88ddd42f8ff18af6037b1e330f4c16d694ab2" exitCode=0 Jun 08 12:12:59.209038 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:12:59.208643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" event={"ID":"ba5384ac-c378-416d-b33f-f063cb8ec541","Type":"ContainerDied","Data":"d4b1f8badfff2d48747ff95a32f88ddd42f8ff18af6037b1e330f4c16d694ab2"} Jun 08 12:13:00.215821 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:00.215787 2575 generic.go:356] "Generic (PLEG): container finished" podID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerID="6bbf894b4ae4316e7f7956ae80828e47067fc8b41c669662cf896f6c7b0bd4ae" exitCode=0 Jun 08 12:13:00.216271 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:00.215826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" event={"ID":"ba5384ac-c378-416d-b33f-f063cb8ec541","Type":"ContainerDied","Data":"6bbf894b4ae4316e7f7956ae80828e47067fc8b41c669662cf896f6c7b0bd4ae"} Jun 08 12:13:01.349117 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.349084 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:13:01.430987 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.430946 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qzsf\" (UniqueName: \"kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf\") pod \"ba5384ac-c378-416d-b33f-f063cb8ec541\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " Jun 08 12:13:01.431192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.431061 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle\") pod \"ba5384ac-c378-416d-b33f-f063cb8ec541\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " Jun 08 12:13:01.431192 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.431096 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util\") pod \"ba5384ac-c378-416d-b33f-f063cb8ec541\" (UID: \"ba5384ac-c378-416d-b33f-f063cb8ec541\") " Jun 08 12:13:01.432324 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.432290 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle" (OuterVolumeSpecName: "bundle") pod "ba5384ac-c378-416d-b33f-f063cb8ec541" (UID: "ba5384ac-c378-416d-b33f-f063cb8ec541"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:13:01.433211 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.433178 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf" (OuterVolumeSpecName: "kube-api-access-6qzsf") pod "ba5384ac-c378-416d-b33f-f063cb8ec541" (UID: "ba5384ac-c378-416d-b33f-f063cb8ec541"). InnerVolumeSpecName "kube-api-access-6qzsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:13:01.437417 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.437278 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util" (OuterVolumeSpecName: "util") pod "ba5384ac-c378-416d-b33f-f063cb8ec541" (UID: "ba5384ac-c378-416d-b33f-f063cb8ec541"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:13:01.532146 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.532027 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:13:01.532146 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.532062 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba5384ac-c378-416d-b33f-f063cb8ec541-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:13:01.532146 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:01.532076 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qzsf\" (UniqueName: \"kubernetes.io/projected/ba5384ac-c378-416d-b33f-f063cb8ec541-kube-api-access-6qzsf\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:13:02.226944 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:02.226916 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" Jun 08 12:13:02.227150 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:02.226912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap6x5l" event={"ID":"ba5384ac-c378-416d-b33f-f063cb8ec541","Type":"ContainerDied","Data":"952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d"} Jun 08 12:13:02.227150 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:02.227053 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="952ad14386274c5dbb26a1b278e5c78eab2d5e79d6448df78d952b014270b74d" Jun 08 12:13:04.185713 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:04.185678 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-ldg5t" Jun 08 12:13:58.264147 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264112 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr"] Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264409 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="pull" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264421 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="pull" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264431 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="util" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264436 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="util" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264446 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="extract" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264452 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="extract" Jun 08 12:13:58.264614 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.264499 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba5384ac-c378-416d-b33f-f063cb8ec541" containerName="extract" Jun 08 12:13:58.268488 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.268467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.271131 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.271077 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:13:58.271324 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.271307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mm794\"" Jun 08 12:13:58.272163 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.272145 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:13:58.275893 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.275867 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr"] Jun 08 12:13:58.443707 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.443669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8pb8\" (UniqueName: \"kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.443810 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.443721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.443858 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.443808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.545172 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.545091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.545172 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.545159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.545337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.545195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8pb8\" (UniqueName: \"kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.545507 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.545486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.545575 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.545507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.553461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.553439 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8pb8\" (UniqueName: \"kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.578221 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.578202 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:13:58.652703 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.651614 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q"] Jun 08 12:13:58.657891 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.657868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.663113 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.663069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q"] Jun 08 12:13:58.712884 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.712729 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr"] Jun 08 12:13:58.715273 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:13:58.715252 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea633f57_d999_4a15_b9a4_7636932ebe06.slice/crio-b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952 WatchSource:0}: Error finding container b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952: Status 404 returned error can't find the container with id b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952 Jun 08 12:13:58.746823 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.746796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnwh\" (UniqueName: \"kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.746923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.746857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.746923 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.746876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.847513 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.847490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.847606 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.847526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.847606 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.847570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnwh\" (UniqueName: \"kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.847821 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.847802 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.847880 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.847864 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.855365 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.855346 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnwh\" (UniqueName: \"kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:58.970540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:58.970521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:13:59.100167 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.100144 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q"] Jun 08 12:13:59.101788 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:13:59.101764 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c12218e_0d17_43a1_9f73_8922c31e0300.slice/crio-7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a WatchSource:0}: Error finding container 7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a: Status 404 returned error can't find the container with id 7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a Jun 08 12:13:59.250858 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.250828 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7"] Jun 08 12:13:59.254048 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.254032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.262812 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.262790 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7"] Jun 08 12:13:59.351809 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.351749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.352131 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.351830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.352131 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.351872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgjg\" (UniqueName: \"kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.452200 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.452179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.452306 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.452219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgjg\" (UniqueName: \"kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.452306 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.452270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.452617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.452594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.452733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.452598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.461017 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.460994 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgjg\" (UniqueName: \"kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.475008 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.474984 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerID="61f4f139b2f598737519ae9a6deca5c02c85ba82a88533bc8d98ea0d1c58230f" exitCode=0 Jun 08 12:13:59.475091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.475060 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" event={"ID":"8c12218e-0d17-43a1-9f73-8922c31e0300","Type":"ContainerDied","Data":"61f4f139b2f598737519ae9a6deca5c02c85ba82a88533bc8d98ea0d1c58230f"} Jun 08 12:13:59.475171 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.475112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" event={"ID":"8c12218e-0d17-43a1-9f73-8922c31e0300","Type":"ContainerStarted","Data":"7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a"} Jun 08 12:13:59.476581 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.476560 2575 generic.go:356] "Generic (PLEG): container finished" podID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerID="f1d550d5477355c6dd3547f1f7c0d96db1aed0f0f5fd3a895b763dda36c53488" exitCode=0 Jun 08 12:13:59.476662 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.476590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" event={"ID":"ea633f57-d999-4a15-b9a4-7636932ebe06","Type":"ContainerDied","Data":"f1d550d5477355c6dd3547f1f7c0d96db1aed0f0f5fd3a895b763dda36c53488"} Jun 08 12:13:59.476662 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.476624 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" event={"ID":"ea633f57-d999-4a15-b9a4-7636932ebe06","Type":"ContainerStarted","Data":"b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952"} Jun 08 12:13:59.563086 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.563068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:13:59.690401 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.690380 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7"] Jun 08 12:13:59.692477 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:13:59.692447 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59475328_e19b_47e8_858c_adc3ae17267a.slice/crio-ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e WatchSource:0}: Error finding container ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e: Status 404 returned error can't find the container with id ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e Jun 08 12:13:59.862438 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.862371 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4"] Jun 08 12:13:59.865588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.865573 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:13:59.876831 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.876809 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4"] Jun 08 12:13:59.956377 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.956354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:13:59.956492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.956399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:13:59.956492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:13:59.956438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hx2b\" (UniqueName: \"kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.057124 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.057088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.057258 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.057143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.057258 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.057174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hx2b\" (UniqueName: \"kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.057431 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.057413 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.057513 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.057491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.066012 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.065987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hx2b\" (UniqueName: \"kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.174150 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.174129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:00.332830 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.332805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4"] Jun 08 12:14:00.355870 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:14:00.355844 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddfca1b_c3e2_43e4_ab1a_2fc8f8d4d081.slice/crio-c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e WatchSource:0}: Error finding container c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e: Status 404 returned error can't find the container with id c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e Jun 08 12:14:00.486187 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.486153 2575 generic.go:356] "Generic (PLEG): container finished" podID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerID="a0a66fc2895e7f29d918fd7234381ec2c4def04b98dc7df0f21ad89e02d71e0d" exitCode=0 Jun 08 12:14:00.486334 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.486232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" event={"ID":"ea633f57-d999-4a15-b9a4-7636932ebe06","Type":"ContainerDied","Data":"a0a66fc2895e7f29d918fd7234381ec2c4def04b98dc7df0f21ad89e02d71e0d"} Jun 08 12:14:00.487739 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.487719 2575 generic.go:356] "Generic (PLEG): container finished" podID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerID="c1a75e29d0be772d029edd7689ad39196bb81109f894e9937b821c166bfcfa43" exitCode=0 Jun 08 12:14:00.487850 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.487790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" event={"ID":"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081","Type":"ContainerDied","Data":"c1a75e29d0be772d029edd7689ad39196bb81109f894e9937b821c166bfcfa43"} Jun 08 12:14:00.487850 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.487825 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" event={"ID":"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081","Type":"ContainerStarted","Data":"c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e"} Jun 08 12:14:00.489353 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.489334 2575 generic.go:356] "Generic (PLEG): container finished" podID="59475328-e19b-47e8-858c-adc3ae17267a" containerID="10ef2c26da533dc436118114b395faf15158687e8c9269484b543355a447f30d" exitCode=0 Jun 08 12:14:00.489462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.489398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" event={"ID":"59475328-e19b-47e8-858c-adc3ae17267a","Type":"ContainerDied","Data":"10ef2c26da533dc436118114b395faf15158687e8c9269484b543355a447f30d"} Jun 08 12:14:00.489462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:00.489426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" event={"ID":"59475328-e19b-47e8-858c-adc3ae17267a","Type":"ContainerStarted","Data":"ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e"} Jun 08 12:14:01.499120 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.499080 2575 generic.go:356] "Generic (PLEG): container finished" podID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerID="bc46238a9600aa581fe7ad7dfcf288a8ca65f1feec4be633d927ae8fa2bcd608" exitCode=0 Jun 08 12:14:01.499437 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.499148 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" event={"ID":"ea633f57-d999-4a15-b9a4-7636932ebe06","Type":"ContainerDied","Data":"bc46238a9600aa581fe7ad7dfcf288a8ca65f1feec4be633d927ae8fa2bcd608"} Jun 08 12:14:01.500834 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.500810 2575 generic.go:356] "Generic (PLEG): container finished" podID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerID="b73a071457ca03b5554394f3bf9d8eebf786311f94a21051723eecd98061bd9d" exitCode=0 Jun 08 12:14:01.500942 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.500848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" event={"ID":"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081","Type":"ContainerDied","Data":"b73a071457ca03b5554394f3bf9d8eebf786311f94a21051723eecd98061bd9d"} Jun 08 12:14:01.502755 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.502733 2575 generic.go:356] "Generic (PLEG): container finished" podID="59475328-e19b-47e8-858c-adc3ae17267a" containerID="df7c08440aeae1df88a579a3b034c09ca275007ee0a25581c5053fc108256ab7" exitCode=0 Jun 08 12:14:01.502952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.502812 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" event={"ID":"59475328-e19b-47e8-858c-adc3ae17267a","Type":"ContainerDied","Data":"df7c08440aeae1df88a579a3b034c09ca275007ee0a25581c5053fc108256ab7"} Jun 08 12:14:01.504764 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.504745 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerID="dea9d1ade4cf22e23ca696334943f9f0ef848f5092db668343fedf31679354dd" exitCode=0 Jun 08 12:14:01.504852 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:01.504792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" event={"ID":"8c12218e-0d17-43a1-9f73-8922c31e0300","Type":"ContainerDied","Data":"dea9d1ade4cf22e23ca696334943f9f0ef848f5092db668343fedf31679354dd"} Jun 08 12:14:02.512064 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.512026 2575 generic.go:356] "Generic (PLEG): container finished" podID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerID="28941895cd98d3c51d337acb2320c1e9917015f42eb348dbf96c255532ce8b6a" exitCode=0 Jun 08 12:14:02.512497 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.512129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" event={"ID":"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081","Type":"ContainerDied","Data":"28941895cd98d3c51d337acb2320c1e9917015f42eb348dbf96c255532ce8b6a"} Jun 08 12:14:02.514596 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.514571 2575 generic.go:356] "Generic (PLEG): container finished" podID="59475328-e19b-47e8-858c-adc3ae17267a" containerID="38dee8900bbcb86a700c85767cb962d28719b8b6caaf9c552bb1020ea597f785" exitCode=0 Jun 08 12:14:02.514753 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.514607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" event={"ID":"59475328-e19b-47e8-858c-adc3ae17267a","Type":"ContainerDied","Data":"38dee8900bbcb86a700c85767cb962d28719b8b6caaf9c552bb1020ea597f785"} Jun 08 12:14:02.517132 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.517091 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerID="0f4ee470bbda18651841f43307dac89788bf479bcef29e50798a3b3e27175ee1" exitCode=0 Jun 08 12:14:02.517231 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.517141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" event={"ID":"8c12218e-0d17-43a1-9f73-8922c31e0300","Type":"ContainerDied","Data":"0f4ee470bbda18651841f43307dac89788bf479bcef29e50798a3b3e27175ee1"} Jun 08 12:14:02.650973 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.650949 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:14:02.780650 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.780592 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8pb8\" (UniqueName: \"kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8\") pod \"ea633f57-d999-4a15-b9a4-7636932ebe06\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " Jun 08 12:14:02.780650 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.780640 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util\") pod \"ea633f57-d999-4a15-b9a4-7636932ebe06\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " Jun 08 12:14:02.780785 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.780685 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle\") pod \"ea633f57-d999-4a15-b9a4-7636932ebe06\" (UID: \"ea633f57-d999-4a15-b9a4-7636932ebe06\") " Jun 08 12:14:02.781206 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.781181 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle" (OuterVolumeSpecName: "bundle") pod "ea633f57-d999-4a15-b9a4-7636932ebe06" (UID: "ea633f57-d999-4a15-b9a4-7636932ebe06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:02.782745 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.782717 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8" (OuterVolumeSpecName: "kube-api-access-b8pb8") pod "ea633f57-d999-4a15-b9a4-7636932ebe06" (UID: "ea633f57-d999-4a15-b9a4-7636932ebe06"). InnerVolumeSpecName "kube-api-access-b8pb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:02.786210 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.786190 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util" (OuterVolumeSpecName: "util") pod "ea633f57-d999-4a15-b9a4-7636932ebe06" (UID: "ea633f57-d999-4a15-b9a4-7636932ebe06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:02.881517 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.881491 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:02.881517 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.881513 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea633f57-d999-4a15-b9a4-7636932ebe06-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:02.881639 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:02.881523 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8pb8\" (UniqueName: \"kubernetes.io/projected/ea633f57-d999-4a15-b9a4-7636932ebe06-kube-api-access-b8pb8\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.523582 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.523558 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" Jun 08 12:14:03.523954 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.523577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr" event={"ID":"ea633f57-d999-4a15-b9a4-7636932ebe06","Type":"ContainerDied","Data":"b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952"} Jun 08 12:14:03.523954 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.523626 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3c3d272bf0a4907cbf6d06cbad43f53fd939b13b3938bfad139a3d1f5797952" Jun 08 12:14:03.662352 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.662330 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:03.700256 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.700233 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:14:03.722733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.722709 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:14:03.790344 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.790320 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle\") pod \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " Jun 08 12:14:03.790465 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.790354 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hx2b\" (UniqueName: \"kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b\") pod \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " Jun 08 12:14:03.790465 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.790373 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util\") pod \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\" (UID: \"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081\") " Jun 08 12:14:03.790818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.790796 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle" (OuterVolumeSpecName: "bundle") pod "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" (UID: "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.792365 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.792344 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b" (OuterVolumeSpecName: "kube-api-access-7hx2b") pod "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" (UID: "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081"). InnerVolumeSpecName "kube-api-access-7hx2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:03.795816 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.795794 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util" (OuterVolumeSpecName: "util") pod "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" (UID: "fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.890760 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890712 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util\") pod \"59475328-e19b-47e8-858c-adc3ae17267a\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " Jun 08 12:14:03.890836 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890762 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkgjg\" (UniqueName: \"kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg\") pod \"59475328-e19b-47e8-858c-adc3ae17267a\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " Jun 08 12:14:03.890836 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890802 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util\") pod \"8c12218e-0d17-43a1-9f73-8922c31e0300\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " Jun 08 12:14:03.890927 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890837 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle\") pod \"59475328-e19b-47e8-858c-adc3ae17267a\" (UID: \"59475328-e19b-47e8-858c-adc3ae17267a\") " Jun 08 12:14:03.890927 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890863 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhnwh\" (UniqueName: \"kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh\") pod \"8c12218e-0d17-43a1-9f73-8922c31e0300\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " Jun 08 12:14:03.890927 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.890886 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle\") pod \"8c12218e-0d17-43a1-9f73-8922c31e0300\" (UID: \"8c12218e-0d17-43a1-9f73-8922c31e0300\") " Jun 08 12:14:03.891073 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.891058 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.891160 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.891078 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hx2b\" (UniqueName: \"kubernetes.io/projected/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-kube-api-access-7hx2b\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.891160 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.891092 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.891470 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.891441 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle" (OuterVolumeSpecName: "bundle") pod "8c12218e-0d17-43a1-9f73-8922c31e0300" (UID: "8c12218e-0d17-43a1-9f73-8922c31e0300"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.891569 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.891522 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle" (OuterVolumeSpecName: "bundle") pod "59475328-e19b-47e8-858c-adc3ae17267a" (UID: "59475328-e19b-47e8-858c-adc3ae17267a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.892862 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.892839 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh" (OuterVolumeSpecName: "kube-api-access-rhnwh") pod "8c12218e-0d17-43a1-9f73-8922c31e0300" (UID: "8c12218e-0d17-43a1-9f73-8922c31e0300"). InnerVolumeSpecName "kube-api-access-rhnwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:03.893178 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.893156 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg" (OuterVolumeSpecName: "kube-api-access-vkgjg") pod "59475328-e19b-47e8-858c-adc3ae17267a" (UID: "59475328-e19b-47e8-858c-adc3ae17267a"). InnerVolumeSpecName "kube-api-access-vkgjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:03.896871 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.896838 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util" (OuterVolumeSpecName: "util") pod "59475328-e19b-47e8-858c-adc3ae17267a" (UID: "59475328-e19b-47e8-858c-adc3ae17267a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.897410 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.897392 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util" (OuterVolumeSpecName: "util") pod "8c12218e-0d17-43a1-9f73-8922c31e0300" (UID: "8c12218e-0d17-43a1-9f73-8922c31e0300"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:03.992118 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992076 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.992195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992128 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.992195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992143 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhnwh\" (UniqueName: \"kubernetes.io/projected/8c12218e-0d17-43a1-9f73-8922c31e0300-kube-api-access-rhnwh\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.992195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992157 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c12218e-0d17-43a1-9f73-8922c31e0300-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.992195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992168 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59475328-e19b-47e8-858c-adc3ae17267a-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:03.992195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:03.992176 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkgjg\" (UniqueName: \"kubernetes.io/projected/59475328-e19b-47e8-858c-adc3ae17267a-kube-api-access-vkgjg\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:14:04.531716 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.531674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" event={"ID":"fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081","Type":"ContainerDied","Data":"c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e"} Jun 08 12:14:04.532081 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.531728 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6ce10393bdf38e901407cda7ee8cf5471984ba6e6fc5ca4c9ccd8ac12f1525e" Jun 08 12:14:04.532081 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.531690 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4" Jun 08 12:14:04.533864 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.533843 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" Jun 08 12:14:04.533977 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.533868 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7" event={"ID":"59475328-e19b-47e8-858c-adc3ae17267a","Type":"ContainerDied","Data":"ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e"} Jun 08 12:14:04.533977 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.533920 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebde190968548ab3fb9f3a2fda9eae57b4a879996ad626e6bc39787e7c2bf79e" Jun 08 12:14:04.535900 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.535873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" event={"ID":"8c12218e-0d17-43a1-9f73-8922c31e0300","Type":"ContainerDied","Data":"7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a"} Jun 08 12:14:04.535900 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.535887 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q" Jun 08 12:14:04.536088 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:04.535915 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b42250bac0648e396a63c282c1d255da43cf932e802dfed9562643ae511622a" Jun 08 12:14:25.105806 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.105771 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx"] Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106075 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="pull" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106086 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="pull" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106098 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="extract" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106121 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="extract" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106133 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="util" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106139 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="util" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106144 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="util" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106150 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="util" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106156 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="extract" Jun 08 12:14:25.106159 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106161 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106168 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106173 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106182 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106186 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106195 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="util" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106203 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="util" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106216 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="util" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106222 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="util" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106227 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106232 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106237 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106241 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106248 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106253 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="pull" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106305 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c12218e-0d17-43a1-9f73-8922c31e0300" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106315 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="59475328-e19b-47e8-858c-adc3ae17267a" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106320 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081" containerName="extract" Jun 08 12:14:25.106461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.106326 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea633f57-d999-4a15-b9a4-7636932ebe06" containerName="extract" Jun 08 12:14:25.110961 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.110946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.113497 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.113474 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:14:25.113601 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.113531 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 12:14:25.113601 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.113539 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 12:14:25.113601 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.113539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:14:25.114567 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.114549 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mm794\"" Jun 08 12:14:25.118256 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.117956 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx"] Jun 08 12:14:25.135718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.135696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.135828 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.135729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b6cca88-ff30-490e-b3db-03931f7f7f0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.135828 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.135756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwrs5\" (UniqueName: \"kubernetes.io/projected/7b6cca88-ff30-490e-b3db-03931f7f7f0b-kube-api-access-fwrs5\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.236804 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.236780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.236896 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.236812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b6cca88-ff30-490e-b3db-03931f7f7f0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.236896 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.236836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwrs5\" (UniqueName: \"kubernetes.io/projected/7b6cca88-ff30-490e-b3db-03931f7f7f0b-kube-api-access-fwrs5\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.236996 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:14:25.236979 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 12:14:25.237061 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:14:25.237050 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert podName:7b6cca88-ff30-490e-b3db-03931f7f7f0b nodeName:}" failed. No retries permitted until 2026-06-08 12:14:25.737031358 +0000 UTC m=+586.896460157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-52lkx" (UID: "7b6cca88-ff30-490e-b3db-03931f7f7f0b") : secret "plugin-serving-cert" not found Jun 08 12:14:25.237411 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.237394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b6cca88-ff30-490e-b3db-03931f7f7f0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.245351 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.245332 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwrs5\" (UniqueName: \"kubernetes.io/projected/7b6cca88-ff30-490e-b3db-03931f7f7f0b-kube-api-access-fwrs5\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.740588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.740563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:25.742857 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:25.742839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6cca88-ff30-490e-b3db-03931f7f7f0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-52lkx\" (UID: \"7b6cca88-ff30-490e-b3db-03931f7f7f0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:26.021186 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:26.021118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" Jun 08 12:14:26.149972 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:26.149947 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx"] Jun 08 12:14:26.152271 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:14:26.152244 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b6cca88_ff30_490e_b3db_03931f7f7f0b.slice/crio-ceb39914455cfafc1b7821c0910238e908d52148232290cc2ce925fbef347216 WatchSource:0}: Error finding container ceb39914455cfafc1b7821c0910238e908d52148232290cc2ce925fbef347216: Status 404 returned error can't find the container with id ceb39914455cfafc1b7821c0910238e908d52148232290cc2ce925fbef347216 Jun 08 12:14:26.649439 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:26.649405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" event={"ID":"7b6cca88-ff30-490e-b3db-03931f7f7f0b","Type":"ContainerStarted","Data":"ceb39914455cfafc1b7821c0910238e908d52148232290cc2ce925fbef347216"} Jun 08 12:14:49.768693 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:49.768660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" event={"ID":"7b6cca88-ff30-490e-b3db-03931f7f7f0b","Type":"ContainerStarted","Data":"d21896dd966b93d4dcebd3e7b7dbf519d789a2f490988d45d501412f46139ebb"} Jun 08 12:14:49.791054 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:14:49.791012 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-52lkx" podStartSLOduration=1.33073252 podStartE2EDuration="24.79099696s" totalImagesPullingTime="23.46026444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:49.789257531 +0000 UTC m=+610.948686335" watchObservedRunningTime="2026-06-08 12:14:49.79099696 +0000 UTC m=+610.950425805" Jun 08 12:15:09.025399 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.025367 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:09.191299 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.191264 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:09.191299 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.191308 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:15:09.191496 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.191393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:09.194019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.193990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-62k7x\"" Jun 08 12:15:09.216871 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.216850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:15:09.217013 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.216949 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:15:09.274573 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.274549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdlc7\" (UniqueName: \"kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7\") pod \"authorino-58cd955675-2l6bj\" (UID: \"567443f7-5e98-4f30-9e68-aa9fd9b83ec0\") " pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:09.374920 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.374869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47zr\" (UniqueName: \"kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr\") pod \"authorino-75d556bd77-9dmlp\" (UID: \"d473fba5-6659-4380-b481-eb144e5a6e9d\") " pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:15:09.374920 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.374917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdlc7\" (UniqueName: \"kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7\") pod \"authorino-58cd955675-2l6bj\" (UID: \"567443f7-5e98-4f30-9e68-aa9fd9b83ec0\") " pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:09.383581 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.383562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdlc7\" (UniqueName: \"kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7\") pod \"authorino-58cd955675-2l6bj\" (UID: \"567443f7-5e98-4f30-9e68-aa9fd9b83ec0\") " pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:09.475274 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.475250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47zr\" (UniqueName: \"kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr\") pod \"authorino-75d556bd77-9dmlp\" (UID: \"d473fba5-6659-4380-b481-eb144e5a6e9d\") " pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:15:09.482916 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.482893 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47zr\" (UniqueName: \"kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr\") pod \"authorino-75d556bd77-9dmlp\" (UID: \"d473fba5-6659-4380-b481-eb144e5a6e9d\") " pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:15:09.500842 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.500823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:09.525906 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.525888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:15:09.649542 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.649504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:09.651964 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:15:09.651936 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod567443f7_5e98_4f30_9e68_aa9fd9b83ec0.slice/crio-935010a1601e9eb46160b5fae9c96a9c1aa9372a75e869615e85f509532428c3 WatchSource:0}: Error finding container 935010a1601e9eb46160b5fae9c96a9c1aa9372a75e869615e85f509532428c3: Status 404 returned error can't find the container with id 935010a1601e9eb46160b5fae9c96a9c1aa9372a75e869615e85f509532428c3 Jun 08 12:15:09.668258 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.668237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:15:09.669609 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:15:09.669585 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd473fba5_6659_4380_b481_eb144e5a6e9d.slice/crio-db14da49a445c03786a24f59207451e7fb939ced7a88041e083d3407e07592b8 WatchSource:0}: Error finding container db14da49a445c03786a24f59207451e7fb939ced7a88041e083d3407e07592b8: Status 404 returned error can't find the container with id db14da49a445c03786a24f59207451e7fb939ced7a88041e083d3407e07592b8 Jun 08 12:15:09.862068 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.862044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9dmlp" event={"ID":"d473fba5-6659-4380-b481-eb144e5a6e9d","Type":"ContainerStarted","Data":"db14da49a445c03786a24f59207451e7fb939ced7a88041e083d3407e07592b8"} Jun 08 12:15:09.863158 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:09.863138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2l6bj" event={"ID":"567443f7-5e98-4f30-9e68-aa9fd9b83ec0","Type":"ContainerStarted","Data":"935010a1601e9eb46160b5fae9c96a9c1aa9372a75e869615e85f509532428c3"} Jun 08 12:15:14.900234 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:14.900199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9dmlp" event={"ID":"d473fba5-6659-4380-b481-eb144e5a6e9d","Type":"ContainerStarted","Data":"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211"} Jun 08 12:15:14.901517 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:14.901494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2l6bj" event={"ID":"567443f7-5e98-4f30-9e68-aa9fd9b83ec0","Type":"ContainerStarted","Data":"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764"} Jun 08 12:15:14.917036 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:14.916994 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9dmlp" podStartSLOduration=1.663363473 podStartE2EDuration="5.916980221s" totalImagesPullingTime="4.253616748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:14.914982348 +0000 UTC m=+636.074411160" watchObservedRunningTime="2026-06-08 12:15:14.916980221 +0000 UTC m=+636.076409012" Jun 08 12:15:14.933086 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:14.933046 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2l6bj" podStartSLOduration=1.6493081269999998 podStartE2EDuration="5.933032971s" totalImagesPullingTime="4.283724844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:14.932192056 +0000 UTC m=+636.091620872" watchObservedRunningTime="2026-06-08 12:15:14.933032971 +0000 UTC m=+636.092461784" Jun 08 12:15:14.955987 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:14.955964 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:16.910679 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:16.910644 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2l6bj" podUID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" containerName="authorino" containerID="cri-o://8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764" gracePeriod=30 Jun 08 12:15:17.155736 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.155707 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:17.338144 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.338119 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdlc7\" (UniqueName: \"kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7\") pod \"567443f7-5e98-4f30-9e68-aa9fd9b83ec0\" (UID: \"567443f7-5e98-4f30-9e68-aa9fd9b83ec0\") " Jun 08 12:15:17.340060 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.340030 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7" (OuterVolumeSpecName: "kube-api-access-kdlc7") pod "567443f7-5e98-4f30-9e68-aa9fd9b83ec0" (UID: "567443f7-5e98-4f30-9e68-aa9fd9b83ec0"). InnerVolumeSpecName "kube-api-access-kdlc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:17.439467 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.439443 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdlc7\" (UniqueName: \"kubernetes.io/projected/567443f7-5e98-4f30-9e68-aa9fd9b83ec0-kube-api-access-kdlc7\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:15:17.915676 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.915650 2575 generic.go:356] "Generic (PLEG): container finished" podID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" containerID="8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764" exitCode=0 Jun 08 12:15:17.915965 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.915692 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2l6bj" Jun 08 12:15:17.915965 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.915736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2l6bj" event={"ID":"567443f7-5e98-4f30-9e68-aa9fd9b83ec0","Type":"ContainerDied","Data":"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764"} Jun 08 12:15:17.915965 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.915776 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2l6bj" event={"ID":"567443f7-5e98-4f30-9e68-aa9fd9b83ec0","Type":"ContainerDied","Data":"935010a1601e9eb46160b5fae9c96a9c1aa9372a75e869615e85f509532428c3"} Jun 08 12:15:17.915965 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.915794 2575 scope.go:117] "RemoveContainer" containerID="8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764" Jun 08 12:15:17.924161 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.924146 2575 scope.go:117] "RemoveContainer" containerID="8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764" Jun 08 12:15:17.924391 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:15:17.924373 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764\": container with ID starting with 8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764 not found: ID does not exist" containerID="8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764" Jun 08 12:15:17.924472 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.924400 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764"} err="failed to get container status \"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764\": rpc error: code = NotFound desc = could not find container \"8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764\": container with ID starting with 8ad8c3424201cdc387b10be091125d6238ec45a2f4a02356cf32efed53482764 not found: ID does not exist" Jun 08 12:15:17.936984 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.936961 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:17.940882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:17.940863 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2l6bj"] Jun 08 12:15:19.326697 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:19.326670 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" path="/var/lib/kubelet/pods/567443f7-5e98-4f30-9e68-aa9fd9b83ec0/volumes" Jun 08 12:15:37.310865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.310828 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg"] Jun 08 12:15:37.311234 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.311128 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" containerName="authorino" Jun 08 12:15:37.311234 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.311139 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" containerName="authorino" Jun 08 12:15:37.311234 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.311189 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="567443f7-5e98-4f30-9e68-aa9fd9b83ec0" containerName="authorino" Jun 08 12:15:37.314765 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.314748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.320145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.320123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:15:37.320248 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.320188 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hjhh5\"" Jun 08 12:15:37.321375 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.321260 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:15:37.339777 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.339751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg"] Jun 08 12:15:37.466032 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.466009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bt2w\" (UniqueName: \"kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.466158 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.466050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.466158 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.466073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.566617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.566556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.566617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.566612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bt2w\" (UniqueName: \"kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.566771 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.566669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.566898 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.566878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.566996 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.566979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.579938 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.579917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bt2w\" (UniqueName: \"kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.623670 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.623649 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:37.753416 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:37.753388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg"] Jun 08 12:15:37.755974 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:15:37.755945 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60d9565_6042_4b92_a758_63d1dd9ab138.slice/crio-bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f WatchSource:0}: Error finding container bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f: Status 404 returned error can't find the container with id bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f Jun 08 12:15:38.008953 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:38.008926 2575 generic.go:356] "Generic (PLEG): container finished" podID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerID="41d9376001c976b4351bc1a33bbbedf90e0ff159b84998cab523eaeef230c873" exitCode=0 Jun 08 12:15:38.009051 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:38.008957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" event={"ID":"a60d9565-6042-4b92-a758-63d1dd9ab138","Type":"ContainerDied","Data":"41d9376001c976b4351bc1a33bbbedf90e0ff159b84998cab523eaeef230c873"} Jun 08 12:15:38.009051 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:38.008989 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" event={"ID":"a60d9565-6042-4b92-a758-63d1dd9ab138","Type":"ContainerStarted","Data":"bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f"} Jun 08 12:15:40.020138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:40.020091 2575 generic.go:356] "Generic (PLEG): container finished" podID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerID="d2c6af549cb0bb0bd9deb9107b08ef75d2d638e44c046eae9fc5dce6f64c4d0b" exitCode=0 Jun 08 12:15:40.020458 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:40.020136 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" event={"ID":"a60d9565-6042-4b92-a758-63d1dd9ab138","Type":"ContainerDied","Data":"d2c6af549cb0bb0bd9deb9107b08ef75d2d638e44c046eae9fc5dce6f64c4d0b"} Jun 08 12:15:41.032039 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:41.032011 2575 generic.go:356] "Generic (PLEG): container finished" podID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerID="281c29a2e6d132391806157763c1f714b8f322f9fa019fefdbbd0bc533594d94" exitCode=0 Jun 08 12:15:41.032406 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:41.032055 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" event={"ID":"a60d9565-6042-4b92-a758-63d1dd9ab138","Type":"ContainerDied","Data":"281c29a2e6d132391806157763c1f714b8f322f9fa019fefdbbd0bc533594d94"} Jun 08 12:15:42.160462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.160436 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:42.300779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.300720 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util\") pod \"a60d9565-6042-4b92-a758-63d1dd9ab138\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " Jun 08 12:15:42.300779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.300760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle\") pod \"a60d9565-6042-4b92-a758-63d1dd9ab138\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " Jun 08 12:15:42.300922 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.300794 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bt2w\" (UniqueName: \"kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w\") pod \"a60d9565-6042-4b92-a758-63d1dd9ab138\" (UID: \"a60d9565-6042-4b92-a758-63d1dd9ab138\") " Jun 08 12:15:42.301252 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.301221 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle" (OuterVolumeSpecName: "bundle") pod "a60d9565-6042-4b92-a758-63d1dd9ab138" (UID: "a60d9565-6042-4b92-a758-63d1dd9ab138"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:42.302647 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.302625 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w" (OuterVolumeSpecName: "kube-api-access-2bt2w") pod "a60d9565-6042-4b92-a758-63d1dd9ab138" (UID: "a60d9565-6042-4b92-a758-63d1dd9ab138"). InnerVolumeSpecName "kube-api-access-2bt2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:42.306896 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.306874 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util" (OuterVolumeSpecName: "util") pod "a60d9565-6042-4b92-a758-63d1dd9ab138" (UID: "a60d9565-6042-4b92-a758-63d1dd9ab138"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:42.401302 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.401281 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-util\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:15:42.401302 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.401300 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60d9565-6042-4b92-a758-63d1dd9ab138-bundle\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:15:42.401418 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:42.401309 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bt2w\" (UniqueName: \"kubernetes.io/projected/a60d9565-6042-4b92-a758-63d1dd9ab138-kube-api-access-2bt2w\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:15:43.045056 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:43.045027 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" Jun 08 12:15:43.045222 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:43.045060 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488gqhg" event={"ID":"a60d9565-6042-4b92-a758-63d1dd9ab138","Type":"ContainerDied","Data":"bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f"} Jun 08 12:15:43.045222 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:15:43.045122 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd2356d52463fd8b812dd043d50bf20293032ca0c37dba4f53253a1c9da1ac4f" Jun 08 12:16:06.980230 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980200 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980469 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="util" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980479 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="util" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980487 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="pull" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980493 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="pull" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980512 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="extract" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980518 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="extract" Jun 08 12:16:06.980666 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.980574 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60d9565-6042-4b92-a758-63d1dd9ab138" containerName="extract" Jun 08 12:16:06.983385 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.983370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:06.986114 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.986073 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:16:06.986237 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.986073 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:16:06.987089 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.987073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 12:16:06.987190 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.987076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4bgjf\"" Jun 08 12:16:06.992721 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:06.992697 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:16:07.054242 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:07.054216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdck\" (UniqueName: \"kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck\") pod \"maas-keycloak-0\" (UID: \"4c2d0365-ec64-4431-9297-278b1d8dd642\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:07.155297 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:07.155276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdck\" (UniqueName: \"kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck\") pod \"maas-keycloak-0\" (UID: \"4c2d0365-ec64-4431-9297-278b1d8dd642\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:07.163633 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:07.163613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdck\" (UniqueName: \"kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck\") pod \"maas-keycloak-0\" (UID: \"4c2d0365-ec64-4431-9297-278b1d8dd642\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:07.293360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:07.293300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:07.416741 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:07.416720 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:16:07.418419 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:16:07.418387 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2d0365_ec64_4431_9297_278b1d8dd642.slice/crio-3883634cb5149cbe7a93d6133271dc91f8e501ebe7f7dbb871d5fa7a09892e37 WatchSource:0}: Error finding container 3883634cb5149cbe7a93d6133271dc91f8e501ebe7f7dbb871d5fa7a09892e37: Status 404 returned error can't find the container with id 3883634cb5149cbe7a93d6133271dc91f8e501ebe7f7dbb871d5fa7a09892e37 Jun 08 12:16:08.157478 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:08.157440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c2d0365-ec64-4431-9297-278b1d8dd642","Type":"ContainerStarted","Data":"3883634cb5149cbe7a93d6133271dc91f8e501ebe7f7dbb871d5fa7a09892e37"} Jun 08 12:16:15.205782 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:15.205744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c2d0365-ec64-4431-9297-278b1d8dd642","Type":"ContainerStarted","Data":"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0"} Jun 08 12:16:15.224318 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:15.224262 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.217460469 podStartE2EDuration="9.224243447s" totalImagesPullingTime="7.006782978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:15.222352269 +0000 UTC m=+696.381781082" watchObservedRunningTime="2026-06-08 12:16:15.224243447 +0000 UTC m=+696.383672262" Jun 08 12:16:15.293535 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:15.293496 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:15.295083 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:15.295046 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:16.294351 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:16.294303 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:17.293976 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:17.293928 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:17.294383 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:17.294284 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:18.294257 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:18.294198 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:19.294730 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:19.294676 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:20.294329 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:20.294286 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:21.294088 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:21.294040 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:22.294476 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:22.294433 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:23.293940 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:23.293904 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:24.294034 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:24.293986 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:25.293949 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:25.293905 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:26.293683 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:26.293641 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 08 12:16:27.384436 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:27.384400 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:27.401227 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:27.401188 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:16:37.390028 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:37.389942 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:16:38.304670 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.304640 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:38.310564 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.310544 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:38.327360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.327321 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:38.434344 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.434318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzlh\" (UniqueName: \"kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh\") pod \"authorino-5d4b67c446-tnrxz\" (UID: \"b7e70c2b-0113-42c7-9b66-e98b767cca28\") " pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:38.535230 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.535200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzlh\" (UniqueName: \"kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh\") pod \"authorino-5d4b67c446-tnrxz\" (UID: \"b7e70c2b-0113-42c7-9b66-e98b767cca28\") " pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:38.546331 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.546309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzlh\" (UniqueName: \"kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh\") pod \"authorino-5d4b67c446-tnrxz\" (UID: \"b7e70c2b-0113-42c7-9b66-e98b767cca28\") " pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:38.556243 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.556192 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:38.556337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.556326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:38.588271 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.588238 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-568d88896b-kkkz4"] Jun 08 12:16:38.590458 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.590440 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:38.604689 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.604668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-568d88896b-kkkz4"] Jun 08 12:16:38.689937 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.689915 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:38.691632 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:16:38.691609 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7e70c2b_0113_42c7_9b66_e98b767cca28.slice/crio-491caf70159f19b37adbf79b23fcc25e06ceb390423bc480645d5cb44caf2afd WatchSource:0}: Error finding container 491caf70159f19b37adbf79b23fcc25e06ceb390423bc480645d5cb44caf2afd: Status 404 returned error can't find the container with id 491caf70159f19b37adbf79b23fcc25e06ceb390423bc480645d5cb44caf2afd Jun 08 12:16:38.692897 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.692883 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:16:38.737033 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.737010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrjtt\" (UniqueName: \"kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt\") pod \"authorino-568d88896b-kkkz4\" (UID: \"045e802f-59b2-4fdf-8a4e-b92e817301bb\") " pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:38.837857 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.837805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrjtt\" (UniqueName: \"kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt\") pod \"authorino-568d88896b-kkkz4\" (UID: \"045e802f-59b2-4fdf-8a4e-b92e817301bb\") " pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:38.842899 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.842877 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-568d88896b-kkkz4"] Jun 08 12:16:38.843083 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:16:38.843065 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mrjtt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-568d88896b-kkkz4" podUID="045e802f-59b2-4fdf-8a4e-b92e817301bb" Jun 08 12:16:38.848717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.848697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrjtt\" (UniqueName: \"kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt\") pod \"authorino-568d88896b-kkkz4\" (UID: \"045e802f-59b2-4fdf-8a4e-b92e817301bb\") " pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:38.895039 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.895016 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:16:38.897838 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.897820 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:38.900724 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.900707 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 12:16:38.916424 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:38.916401 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:16:39.039085 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.039065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.039183 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.039165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ws27\" (UniqueName: \"kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.140459 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.140400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ws27\" (UniqueName: \"kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.140459 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.140453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.142570 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.142555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.151865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.151846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ws27\" (UniqueName: \"kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27\") pod \"authorino-b596bc74b-hdgg6\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.206635 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.206613 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:16:39.339490 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.339463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:16:39.340588 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:16:39.340563 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6582a319_14f3_430f_9a9b_4d6facd2efa1.slice/crio-1908817780f8279b9ad2da8ca8b25cf2d94e4e2e87e1f543307f904903a95c80 WatchSource:0}: Error finding container 1908817780f8279b9ad2da8ca8b25cf2d94e4e2e87e1f543307f904903a95c80: Status 404 returned error can't find the container with id 1908817780f8279b9ad2da8ca8b25cf2d94e4e2e87e1f543307f904903a95c80 Jun 08 12:16:39.352599 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.352574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b596bc74b-hdgg6" event={"ID":"6582a319-14f3-430f-9a9b-4d6facd2efa1","Type":"ContainerStarted","Data":"1908817780f8279b9ad2da8ca8b25cf2d94e4e2e87e1f543307f904903a95c80"} Jun 08 12:16:39.354140 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.354096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" event={"ID":"b7e70c2b-0113-42c7-9b66-e98b767cca28","Type":"ContainerStarted","Data":"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52"} Jun 08 12:16:39.354227 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.354157 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" event={"ID":"b7e70c2b-0113-42c7-9b66-e98b767cca28","Type":"ContainerStarted","Data":"491caf70159f19b37adbf79b23fcc25e06ceb390423bc480645d5cb44caf2afd"} Jun 08 12:16:39.354227 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.354129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:39.354227 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.354121 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" podUID="b7e70c2b-0113-42c7-9b66-e98b767cca28" containerName="authorino" containerID="cri-o://4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52" gracePeriod=30 Jun 08 12:16:39.360934 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.360917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:39.378347 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.378291 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" podStartSLOduration=0.832672558 podStartE2EDuration="1.378279006s" totalImagesPullingTime="545.606448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:39.377056895 +0000 UTC m=+720.536485707" watchObservedRunningTime="2026-06-08 12:16:39.378279006 +0000 UTC m=+720.537707819" Jun 08 12:16:39.442140 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.442118 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrjtt\" (UniqueName: \"kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt\") pod \"045e802f-59b2-4fdf-8a4e-b92e817301bb\" (UID: \"045e802f-59b2-4fdf-8a4e-b92e817301bb\") " Jun 08 12:16:39.443942 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.443921 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt" (OuterVolumeSpecName: "kube-api-access-mrjtt") pod "045e802f-59b2-4fdf-8a4e-b92e817301bb" (UID: "045e802f-59b2-4fdf-8a4e-b92e817301bb"). InnerVolumeSpecName "kube-api-access-mrjtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:39.543615 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.543588 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrjtt\" (UniqueName: \"kubernetes.io/projected/045e802f-59b2-4fdf-8a4e-b92e817301bb-kube-api-access-mrjtt\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:16:39.604355 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.604335 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:39.745997 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.745942 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgzlh\" (UniqueName: \"kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh\") pod \"b7e70c2b-0113-42c7-9b66-e98b767cca28\" (UID: \"b7e70c2b-0113-42c7-9b66-e98b767cca28\") " Jun 08 12:16:39.747761 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.747742 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh" (OuterVolumeSpecName: "kube-api-access-lgzlh") pod "b7e70c2b-0113-42c7-9b66-e98b767cca28" (UID: "b7e70c2b-0113-42c7-9b66-e98b767cca28"). InnerVolumeSpecName "kube-api-access-lgzlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:39.846922 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:39.846901 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgzlh\" (UniqueName: \"kubernetes.io/projected/b7e70c2b-0113-42c7-9b66-e98b767cca28-kube-api-access-lgzlh\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:16:40.360713 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.360678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b596bc74b-hdgg6" event={"ID":"6582a319-14f3-430f-9a9b-4d6facd2efa1","Type":"ContainerStarted","Data":"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b"} Jun 08 12:16:40.361837 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.361813 2575 generic.go:356] "Generic (PLEG): container finished" podID="b7e70c2b-0113-42c7-9b66-e98b767cca28" containerID="4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52" exitCode=0 Jun 08 12:16:40.361951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.361844 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" Jun 08 12:16:40.361951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.361891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" event={"ID":"b7e70c2b-0113-42c7-9b66-e98b767cca28","Type":"ContainerDied","Data":"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52"} Jun 08 12:16:40.361951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.361922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tnrxz" event={"ID":"b7e70c2b-0113-42c7-9b66-e98b767cca28","Type":"ContainerDied","Data":"491caf70159f19b37adbf79b23fcc25e06ceb390423bc480645d5cb44caf2afd"} Jun 08 12:16:40.361951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.361939 2575 scope.go:117] "RemoveContainer" containerID="4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52" Jun 08 12:16:40.362078 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.362019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568d88896b-kkkz4" Jun 08 12:16:40.370657 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.370641 2575 scope.go:117] "RemoveContainer" containerID="4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52" Jun 08 12:16:40.370917 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:16:40.370900 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52\": container with ID starting with 4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52 not found: ID does not exist" containerID="4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52" Jun 08 12:16:40.370959 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.370926 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52"} err="failed to get container status \"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52\": rpc error: code = NotFound desc = could not find container \"4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52\": container with ID starting with 4e813df71a633dd5ca29f789a61f1b4df4386df66fd6bf291ac5d9f331f8ea52 not found: ID does not exist" Jun 08 12:16:40.380606 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.380557 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b596bc74b-hdgg6" podStartSLOduration=1.7942393380000001 podStartE2EDuration="2.380544589s" totalImagesPullingTime="586.305251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:40.379253781 +0000 UTC m=+721.538682593" watchObservedRunningTime="2026-06-08 12:16:40.380544589 +0000 UTC m=+721.539973403" Jun 08 12:16:40.401368 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.401348 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:40.408750 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.408726 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tnrxz"] Jun 08 12:16:40.420743 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.420724 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:16:40.420879 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.420863 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9dmlp" podUID="d473fba5-6659-4380-b481-eb144e5a6e9d" containerName="authorino" containerID="cri-o://d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211" gracePeriod=30 Jun 08 12:16:40.446955 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.446927 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-568d88896b-kkkz4"] Jun 08 12:16:40.450885 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.450863 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-568d88896b-kkkz4"] Jun 08 12:16:40.663317 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.663284 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:16:40.753349 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.753323 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t47zr\" (UniqueName: \"kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr\") pod \"d473fba5-6659-4380-b481-eb144e5a6e9d\" (UID: \"d473fba5-6659-4380-b481-eb144e5a6e9d\") " Jun 08 12:16:40.755145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.755118 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr" (OuterVolumeSpecName: "kube-api-access-t47zr") pod "d473fba5-6659-4380-b481-eb144e5a6e9d" (UID: "d473fba5-6659-4380-b481-eb144e5a6e9d"). InnerVolumeSpecName "kube-api-access-t47zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:40.853800 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:40.853778 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t47zr\" (UniqueName: \"kubernetes.io/projected/d473fba5-6659-4380-b481-eb144e5a6e9d-kube-api-access-t47zr\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:16:41.326685 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.326658 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045e802f-59b2-4fdf-8a4e-b92e817301bb" path="/var/lib/kubelet/pods/045e802f-59b2-4fdf-8a4e-b92e817301bb/volumes" Jun 08 12:16:41.326925 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.326908 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7e70c2b-0113-42c7-9b66-e98b767cca28" path="/var/lib/kubelet/pods/b7e70c2b-0113-42c7-9b66-e98b767cca28/volumes" Jun 08 12:16:41.367976 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.367955 2575 generic.go:356] "Generic (PLEG): container finished" podID="d473fba5-6659-4380-b481-eb144e5a6e9d" containerID="d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211" exitCode=0 Jun 08 12:16:41.368119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.367995 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9dmlp" Jun 08 12:16:41.368119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.368041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9dmlp" event={"ID":"d473fba5-6659-4380-b481-eb144e5a6e9d","Type":"ContainerDied","Data":"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211"} Jun 08 12:16:41.368119 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.368082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9dmlp" event={"ID":"d473fba5-6659-4380-b481-eb144e5a6e9d","Type":"ContainerDied","Data":"db14da49a445c03786a24f59207451e7fb939ced7a88041e083d3407e07592b8"} Jun 08 12:16:41.368298 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.368125 2575 scope.go:117] "RemoveContainer" containerID="d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211" Jun 08 12:16:41.376482 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.376468 2575 scope.go:117] "RemoveContainer" containerID="d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211" Jun 08 12:16:41.376730 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:16:41.376712 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211\": container with ID starting with d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211 not found: ID does not exist" containerID="d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211" Jun 08 12:16:41.376786 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.376738 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211"} err="failed to get container status \"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211\": rpc error: code = NotFound desc = could not find container \"d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211\": container with ID starting with d671b53c42037228db72f8b4a365bd90970d112cfe1b4aaa1c859f7a0c4ab211 not found: ID does not exist" Jun 08 12:16:41.387842 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.387822 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:16:41.392494 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:41.392475 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9dmlp"] Jun 08 12:16:43.326629 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:43.326590 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d473fba5-6659-4380-b481-eb144e5a6e9d" path="/var/lib/kubelet/pods/d473fba5-6659-4380-b481-eb144e5a6e9d/volumes" Jun 08 12:16:44.254865 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.254838 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:16:44.255143 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255130 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d473fba5-6659-4380-b481-eb144e5a6e9d" containerName="authorino" Jun 08 12:16:44.255196 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255144 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d473fba5-6659-4380-b481-eb144e5a6e9d" containerName="authorino" Jun 08 12:16:44.255196 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255154 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e70c2b-0113-42c7-9b66-e98b767cca28" containerName="authorino" Jun 08 12:16:44.255196 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255159 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e70c2b-0113-42c7-9b66-e98b767cca28" containerName="authorino" Jun 08 12:16:44.255284 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255215 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d473fba5-6659-4380-b481-eb144e5a6e9d" containerName="authorino" Jun 08 12:16:44.255284 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.255225 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7e70c2b-0113-42c7-9b66-e98b767cca28" containerName="authorino" Jun 08 12:16:44.257749 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.257735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.263013 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.262992 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 12:16:44.263145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.263073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v9pq\"" Jun 08 12:16:44.267588 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.267571 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 12:16:44.285863 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.285839 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:16:44.377304 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.377280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qndnk\" (UniqueName: \"kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.377560 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.377327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.477753 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.477731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.477837 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.477773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qndnk\" (UniqueName: \"kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.477881 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:16:44.477870 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 12:16:44.477930 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:16:44.477921 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert podName:549a7fe3-f2ea-4b84-a006-92342123b3ab nodeName:}" failed. No retries permitted until 2026-06-08 12:16:44.977907151 +0000 UTC m=+726.137335943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert") pod "maas-controller-7f4c8576f4-mnx5w" (UID: "549a7fe3-f2ea-4b84-a006-92342123b3ab") : secret "maas-controller-webhook-cert" not found Jun 08 12:16:44.490954 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.490934 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:16:44.492963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.492947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.498619 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.498601 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qndnk\" (UniqueName: \"kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.513804 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.513758 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:16:44.578605 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.578587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rmrr\" (UniqueName: \"kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.578699 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.578611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.679446 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.679426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rmrr\" (UniqueName: \"kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.679538 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.679453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.681553 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.681530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.690335 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.690315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rmrr\" (UniqueName: \"kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr\") pod \"maas-controller-7bf6cb8f9f-2475m\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.808802 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.808756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:44.944983 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.944961 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:16:44.945690 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:16:44.945664 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4723a54_985e_45c7_b7b6_0a1baf995ffd.slice/crio-6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576 WatchSource:0}: Error finding container 6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576: Status 404 returned error can't find the container with id 6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576 Jun 08 12:16:44.981818 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.981791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:44.983863 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:44.983839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") pod \"maas-controller-7f4c8576f4-mnx5w\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:45.168199 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:45.168143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:45.303436 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:16:45.303405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549a7fe3_f2ea_4b84_a006_92342123b3ab.slice/crio-f080129bd02942296b09629e5b1b64656819a97f72eec33170741409f0509cf2 WatchSource:0}: Error finding container f080129bd02942296b09629e5b1b64656819a97f72eec33170741409f0509cf2: Status 404 returned error can't find the container with id f080129bd02942296b09629e5b1b64656819a97f72eec33170741409f0509cf2 Jun 08 12:16:45.304510 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:45.304486 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:16:45.394463 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:45.394441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" event={"ID":"d4723a54-985e-45c7-b7b6-0a1baf995ffd","Type":"ContainerStarted","Data":"6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576"} Jun 08 12:16:45.395557 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:45.395538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" event={"ID":"549a7fe3-f2ea-4b84-a006-92342123b3ab","Type":"ContainerStarted","Data":"f080129bd02942296b09629e5b1b64656819a97f72eec33170741409f0509cf2"} Jun 08 12:16:48.418230 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.418196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" event={"ID":"549a7fe3-f2ea-4b84-a006-92342123b3ab","Type":"ContainerStarted","Data":"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f"} Jun 08 12:16:48.418631 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.418372 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:48.419678 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.419654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" event={"ID":"d4723a54-985e-45c7-b7b6-0a1baf995ffd","Type":"ContainerStarted","Data":"238d3504f6a99d60ef2d07f35c308b123cde2ead1530392ffb2bf287287c654b"} Jun 08 12:16:48.419815 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.419773 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:48.467547 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.467489 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" podStartSLOduration=2.065424396 podStartE2EDuration="4.467474331s" totalImagesPullingTime="2.402049935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:48.443084182 +0000 UTC m=+729.602512995" watchObservedRunningTime="2026-06-08 12:16:48.467474331 +0000 UTC m=+729.626903178" Jun 08 12:16:48.469363 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:48.469318 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" podStartSLOduration=1.7189399920000001 podStartE2EDuration="4.469303106s" totalImagesPullingTime="2.750363114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:48.467079375 +0000 UTC m=+729.626508186" watchObservedRunningTime="2026-06-08 12:16:48.469303106 +0000 UTC m=+729.628731918" Jun 08 12:16:59.429403 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.429375 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:16:59.429792 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.429435 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:59.501638 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.501606 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:16:59.501806 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.501786 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" podUID="549a7fe3-f2ea-4b84-a006-92342123b3ab" containerName="manager" containerID="cri-o://9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f" gracePeriod=30 Jun 08 12:16:59.735194 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.735167 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:16:59.884395 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.884370 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") pod \"549a7fe3-f2ea-4b84-a006-92342123b3ab\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " Jun 08 12:16:59.884512 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.884407 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qndnk\" (UniqueName: \"kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk\") pod \"549a7fe3-f2ea-4b84-a006-92342123b3ab\" (UID: \"549a7fe3-f2ea-4b84-a006-92342123b3ab\") " Jun 08 12:16:59.886408 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.886376 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "549a7fe3-f2ea-4b84-a006-92342123b3ab" (UID: "549a7fe3-f2ea-4b84-a006-92342123b3ab"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:16:59.886408 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.886391 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk" (OuterVolumeSpecName: "kube-api-access-qndnk") pod "549a7fe3-f2ea-4b84-a006-92342123b3ab" (UID: "549a7fe3-f2ea-4b84-a006-92342123b3ab"). InnerVolumeSpecName "kube-api-access-qndnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:59.985828 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.985774 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/549a7fe3-f2ea-4b84-a006-92342123b3ab-webhook-cert\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:16:59.985828 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:16:59.985795 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qndnk\" (UniqueName: \"kubernetes.io/projected/549a7fe3-f2ea-4b84-a006-92342123b3ab-kube-api-access-qndnk\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:17:00.478336 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.478305 2575 generic.go:356] "Generic (PLEG): container finished" podID="549a7fe3-f2ea-4b84-a006-92342123b3ab" containerID="9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f" exitCode=0 Jun 08 12:17:00.478718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.478349 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" Jun 08 12:17:00.478718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.478399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" event={"ID":"549a7fe3-f2ea-4b84-a006-92342123b3ab","Type":"ContainerDied","Data":"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f"} Jun 08 12:17:00.478718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.478466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c8576f4-mnx5w" event={"ID":"549a7fe3-f2ea-4b84-a006-92342123b3ab","Type":"ContainerDied","Data":"f080129bd02942296b09629e5b1b64656819a97f72eec33170741409f0509cf2"} Jun 08 12:17:00.478718 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.478498 2575 scope.go:117] "RemoveContainer" containerID="9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f" Jun 08 12:17:00.487844 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.487829 2575 scope.go:117] "RemoveContainer" containerID="9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f" Jun 08 12:17:00.488082 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:17:00.488063 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f\": container with ID starting with 9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f not found: ID does not exist" containerID="9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f" Jun 08 12:17:00.488145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.488091 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f"} err="failed to get container status \"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f\": rpc error: code = NotFound desc = could not find container \"9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f\": container with ID starting with 9b6b8d18e673f9e3c60bb3c05ded215d8871cc0010756b0d0df3bd476211338f not found: ID does not exist" Jun 08 12:17:00.504432 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.504412 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:17:00.509407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:00.509386 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f4c8576f4-mnx5w"] Jun 08 12:17:01.327021 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:01.326991 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549a7fe3-f2ea-4b84-a006-92342123b3ab" path="/var/lib/kubelet/pods/549a7fe3-f2ea-4b84-a006-92342123b3ab/volumes" Jun 08 12:17:18.851195 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.851149 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xwc9w"] Jun 08 12:17:18.851897 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.851876 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549a7fe3-f2ea-4b84-a006-92342123b3ab" containerName="manager" Jun 08 12:17:18.851989 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.851899 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="549a7fe3-f2ea-4b84-a006-92342123b3ab" containerName="manager" Jun 08 12:17:18.852087 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.852074 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="549a7fe3-f2ea-4b84-a006-92342123b3ab" containerName="manager" Jun 08 12:17:18.855513 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.855486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:18.862763 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.862740 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 12:17:18.863281 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.863262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6kdwd\"" Jun 08 12:17:18.880654 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.880622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xwc9w"] Jun 08 12:17:18.914088 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.914064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsskt\" (UniqueName: \"kubernetes.io/projected/f2fafa1e-3ffc-49f3-85f8-d42a0a01b946-kube-api-access-gsskt\") pod \"payload-pre-processing-67d7689b65-xwc9w\" (UID: \"f2fafa1e-3ffc-49f3-85f8-d42a0a01b946\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:18.983973 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.983952 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-j7hkq"] Jun 08 12:17:18.986175 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:18.986160 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:19.014562 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.014540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxphh\" (UniqueName: \"kubernetes.io/projected/2ad85e35-1396-457a-876a-8f5c178417f3-kube-api-access-gxphh\") pod \"payload-processing-7c6c859784-j7hkq\" (UID: \"2ad85e35-1396-457a-876a-8f5c178417f3\") " pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:19.014652 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.014603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsskt\" (UniqueName: \"kubernetes.io/projected/f2fafa1e-3ffc-49f3-85f8-d42a0a01b946-kube-api-access-gsskt\") pod \"payload-pre-processing-67d7689b65-xwc9w\" (UID: \"f2fafa1e-3ffc-49f3-85f8-d42a0a01b946\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:19.020697 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.020676 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-j7hkq"] Jun 08 12:17:19.038243 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.038218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsskt\" (UniqueName: \"kubernetes.io/projected/f2fafa1e-3ffc-49f3-85f8-d42a0a01b946-kube-api-access-gsskt\") pod \"payload-pre-processing-67d7689b65-xwc9w\" (UID: \"f2fafa1e-3ffc-49f3-85f8-d42a0a01b946\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:19.115620 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.115553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxphh\" (UniqueName: \"kubernetes.io/projected/2ad85e35-1396-457a-876a-8f5c178417f3-kube-api-access-gxphh\") pod \"payload-processing-7c6c859784-j7hkq\" (UID: \"2ad85e35-1396-457a-876a-8f5c178417f3\") " pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:19.126952 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.126930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxphh\" (UniqueName: \"kubernetes.io/projected/2ad85e35-1396-457a-876a-8f5c178417f3-kube-api-access-gxphh\") pod \"payload-processing-7c6c859784-j7hkq\" (UID: \"2ad85e35-1396-457a-876a-8f5c178417f3\") " pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:19.165849 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.165825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:19.295524 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.295499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:19.333579 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.333558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xwc9w"] Jun 08 12:17:19.334445 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:17:19.334415 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fafa1e_3ffc_49f3_85f8_d42a0a01b946.slice/crio-ae95a0f3c70c3387e6d028d0949141f1839555246c9e7c019bf91ed0530a130f WatchSource:0}: Error finding container ae95a0f3c70c3387e6d028d0949141f1839555246c9e7c019bf91ed0530a130f: Status 404 returned error can't find the container with id ae95a0f3c70c3387e6d028d0949141f1839555246c9e7c019bf91ed0530a130f Jun 08 12:17:19.450557 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.450536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-j7hkq"] Jun 08 12:17:19.452383 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:17:19.452356 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad85e35_1396_457a_876a_8f5c178417f3.slice/crio-628fed1fe2a8529b659ed5576a95d59b1cf3c50b89ab6f658d74e2c27c047852 WatchSource:0}: Error finding container 628fed1fe2a8529b659ed5576a95d59b1cf3c50b89ab6f658d74e2c27c047852: Status 404 returned error can't find the container with id 628fed1fe2a8529b659ed5576a95d59b1cf3c50b89ab6f658d74e2c27c047852 Jun 08 12:17:19.569093 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.569066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" event={"ID":"2ad85e35-1396-457a-876a-8f5c178417f3","Type":"ContainerStarted","Data":"628fed1fe2a8529b659ed5576a95d59b1cf3c50b89ab6f658d74e2c27c047852"} Jun 08 12:17:19.570220 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:19.570193 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" event={"ID":"f2fafa1e-3ffc-49f3-85f8-d42a0a01b946","Type":"ContainerStarted","Data":"ae95a0f3c70c3387e6d028d0949141f1839555246c9e7c019bf91ed0530a130f"} Jun 08 12:17:21.583507 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.583473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" event={"ID":"2ad85e35-1396-457a-876a-8f5c178417f3","Type":"ContainerStarted","Data":"5a5cdd228f1a8346e872d501cc22f738c10886bd7a02f8024dea98df70354b1e"} Jun 08 12:17:21.583932 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.583644 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:21.584888 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.584865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" event={"ID":"f2fafa1e-3ffc-49f3-85f8-d42a0a01b946","Type":"ContainerStarted","Data":"4226023b13865529be09d313cb8652a0455278455b95b654f9eefd83b78ad5cc"} Jun 08 12:17:21.585009 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.584914 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:21.613250 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.613210 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" podStartSLOduration=2.110063039 podStartE2EDuration="3.613199019s" totalImagesPullingTime="1.50313598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:21.610016702 +0000 UTC m=+762.769445517" watchObservedRunningTime="2026-06-08 12:17:21.613199019 +0000 UTC m=+762.772627833" Jun 08 12:17:21.640499 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:21.640461 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" podStartSLOduration=2.031166401 podStartE2EDuration="3.640449807s" totalImagesPullingTime="1.609283406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:21.639269306 +0000 UTC m=+762.798698157" watchObservedRunningTime="2026-06-08 12:17:21.640449807 +0000 UTC m=+762.799878621" Jun 08 12:17:30.076670 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:30.076639 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:30.077122 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:30.076808 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" containerID="cri-o://6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0" gracePeriod=30 Jun 08 12:17:31.621382 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.621360 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:31.635358 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.635337 2575 generic.go:356] "Generic (PLEG): container finished" podID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerID="6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0" exitCode=143 Jun 08 12:17:31.635462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.635374 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:31.635462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.635389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c2d0365-ec64-4431-9297-278b1d8dd642","Type":"ContainerDied","Data":"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0"} Jun 08 12:17:31.635462 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.635446 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c2d0365-ec64-4431-9297-278b1d8dd642","Type":"ContainerDied","Data":"3883634cb5149cbe7a93d6133271dc91f8e501ebe7f7dbb871d5fa7a09892e37"} Jun 08 12:17:31.635624 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.635473 2575 scope.go:117] "RemoveContainer" containerID="6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0" Jun 08 12:17:31.645715 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.645699 2575 scope.go:117] "RemoveContainer" containerID="6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0" Jun 08 12:17:31.645962 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:17:31.645931 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0\": container with ID starting with 6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0 not found: ID does not exist" containerID="6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0" Jun 08 12:17:31.646036 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.645961 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0"} err="failed to get container status \"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0\": rpc error: code = NotFound desc = could not find container \"6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0\": container with ID starting with 6962249f650cc4c89d9f5b45174a7e9595123f162841be3210bb6d416a65dcb0 not found: ID does not exist" Jun 08 12:17:31.695162 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.695142 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkdck\" (UniqueName: \"kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck\") pod \"4c2d0365-ec64-4431-9297-278b1d8dd642\" (UID: \"4c2d0365-ec64-4431-9297-278b1d8dd642\") " Jun 08 12:17:31.697043 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.697018 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck" (OuterVolumeSpecName: "kube-api-access-dkdck") pod "4c2d0365-ec64-4431-9297-278b1d8dd642" (UID: "4c2d0365-ec64-4431-9297-278b1d8dd642"). InnerVolumeSpecName "kube-api-access-dkdck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:17:31.796436 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.796386 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkdck\" (UniqueName: \"kubernetes.io/projected/4c2d0365-ec64-4431-9297-278b1d8dd642-kube-api-access-dkdck\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:17:31.957312 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.957286 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:31.961236 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.961217 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:31.991055 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.991033 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:31.991357 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.991344 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" Jun 08 12:17:31.991405 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.991358 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" Jun 08 12:17:31.991437 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.991415 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" containerName="keycloak" Jun 08 12:17:31.994603 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.994588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:31.997150 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.997128 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 12:17:31.997275 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.997181 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 12:17:31.997275 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.997218 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:17:31.997465 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.997448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:17:31.997540 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:31.997485 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4bgjf\"" Jun 08 12:17:32.008278 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.008258 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:32.098188 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.098136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tbq5\" (UniqueName: \"kubernetes.io/projected/f46bc065-6029-45d9-b052-efe5a6f167e9-kube-api-access-4tbq5\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.098289 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.098189 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f46bc065-6029-45d9-b052-efe5a6f167e9-test-realms\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.199223 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.199201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f46bc065-6029-45d9-b052-efe5a6f167e9-test-realms\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.199317 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.199245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tbq5\" (UniqueName: \"kubernetes.io/projected/f46bc065-6029-45d9-b052-efe5a6f167e9-kube-api-access-4tbq5\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.199832 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.199814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f46bc065-6029-45d9-b052-efe5a6f167e9-test-realms\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.210110 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.210080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tbq5\" (UniqueName: \"kubernetes.io/projected/f46bc065-6029-45d9-b052-efe5a6f167e9-kube-api-access-4tbq5\") pod \"maas-keycloak-0\" (UID: \"f46bc065-6029-45d9-b052-efe5a6f167e9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.304346 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.304314 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:32.434213 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.434192 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:17:32.435840 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:17:32.435806 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46bc065_6029_45d9_b052_efe5a6f167e9.slice/crio-d5658f9298664459d3ad60ebc618eaf0aa95f579cb53614965d3c62510b5c497 WatchSource:0}: Error finding container d5658f9298664459d3ad60ebc618eaf0aa95f579cb53614965d3c62510b5c497: Status 404 returned error can't find the container with id d5658f9298664459d3ad60ebc618eaf0aa95f579cb53614965d3c62510b5c497 Jun 08 12:17:32.593958 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.593938 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-j7hkq" Jun 08 12:17:32.594928 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.594910 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-xwc9w" Jun 08 12:17:32.643084 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:32.643020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f46bc065-6029-45d9-b052-efe5a6f167e9","Type":"ContainerStarted","Data":"d5658f9298664459d3ad60ebc618eaf0aa95f579cb53614965d3c62510b5c497"} Jun 08 12:17:33.328767 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:33.328736 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2d0365-ec64-4431-9297-278b1d8dd642" path="/var/lib/kubelet/pods/4c2d0365-ec64-4431-9297-278b1d8dd642/volumes" Jun 08 12:17:33.650332 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:33.650244 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f46bc065-6029-45d9-b052-efe5a6f167e9","Type":"ContainerStarted","Data":"788f7ea4993ee38edb2ed91bd2ff8da74c6068ca5ec633bf6ce2eb6600de80c9"} Jun 08 12:17:33.673154 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:33.673077 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.324050352 podStartE2EDuration="2.673058646s" totalImagesPullingTime="349.008294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:33.670449312 +0000 UTC m=+774.829878148" watchObservedRunningTime="2026-06-08 12:17:33.673058646 +0000 UTC m=+774.832487461" Jun 08 12:17:34.305486 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:34.305442 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:34.307300 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:34.307260 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:35.305177 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:35.305118 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:36.305528 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:36.305479 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:37.305516 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:37.305460 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:38.305531 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:38.305490 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:39.305280 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:39.305239 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:40.305139 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:40.305071 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:41.304976 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:41.304931 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:42.304963 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:42.304925 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:42.305421 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:42.305195 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:43.305148 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:43.305089 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:44.305070 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:44.305016 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 08 12:17:45.399412 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:45.399362 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 12:17:45.413018 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:45.412981 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f46bc065-6029-45d9-b052-efe5a6f167e9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:17:55.405251 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:17:55.405220 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 12:18:06.115717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.115643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:18:06.118249 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.118232 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.120859 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.120838 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 12:18:06.127474 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.127451 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:18:06.195863 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.195842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.195950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.195877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.195950 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.195930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbn5\" (UniqueName: \"kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.296693 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.296661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.296693 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.296698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.296857 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.296736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbn5\" (UniqueName: \"kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.297334 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.297314 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.298884 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.298867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.322722 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.319679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbn5\" (UniqueName: \"kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5\") pod \"authorino-597df7d888-hnwc6\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.427698 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.427681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:18:06.559977 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.559948 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:18:06.561119 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:18:06.561081 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05016bac_dad6_4936_aba9_acbf45791d04.slice/crio-10aad6a51e1615454ece5c82a95d3deaa612ac737f7a147bc6fad24fdc4d2845 WatchSource:0}: Error finding container 10aad6a51e1615454ece5c82a95d3deaa612ac737f7a147bc6fad24fdc4d2845: Status 404 returned error can't find the container with id 10aad6a51e1615454ece5c82a95d3deaa612ac737f7a147bc6fad24fdc4d2845 Jun 08 12:18:06.851470 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:06.851409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597df7d888-hnwc6" event={"ID":"05016bac-dad6-4936-aba9-acbf45791d04","Type":"ContainerStarted","Data":"10aad6a51e1615454ece5c82a95d3deaa612ac737f7a147bc6fad24fdc4d2845"} Jun 08 12:18:07.858557 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:07.858521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597df7d888-hnwc6" event={"ID":"05016bac-dad6-4936-aba9-acbf45791d04","Type":"ContainerStarted","Data":"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8"} Jun 08 12:18:07.879784 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:07.879740 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-597df7d888-hnwc6" podStartSLOduration=1.3158442080000001 podStartE2EDuration="1.879727637s" totalImagesPullingTime="563.883429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:07.877793608 +0000 UTC m=+809.037222422" watchObservedRunningTime="2026-06-08 12:18:07.879727637 +0000 UTC m=+809.039156451" Jun 08 12:18:07.912360 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:07.912326 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:18:07.912519 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:07.912481 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b596bc74b-hdgg6" podUID="6582a319-14f3-430f-9a9b-4d6facd2efa1" containerName="authorino" containerID="cri-o://bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b" gracePeriod=30 Jun 08 12:18:08.158684 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.158661 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:18:08.311685 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.311661 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert\") pod \"6582a319-14f3-430f-9a9b-4d6facd2efa1\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " Jun 08 12:18:08.311795 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.311691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ws27\" (UniqueName: \"kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27\") pod \"6582a319-14f3-430f-9a9b-4d6facd2efa1\" (UID: \"6582a319-14f3-430f-9a9b-4d6facd2efa1\") " Jun 08 12:18:08.313856 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.313824 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27" (OuterVolumeSpecName: "kube-api-access-8ws27") pod "6582a319-14f3-430f-9a9b-4d6facd2efa1" (UID: "6582a319-14f3-430f-9a9b-4d6facd2efa1"). InnerVolumeSpecName "kube-api-access-8ws27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:18:08.321483 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.321459 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6582a319-14f3-430f-9a9b-4d6facd2efa1" (UID: "6582a319-14f3-430f-9a9b-4d6facd2efa1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:18:08.413140 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.413065 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6582a319-14f3-430f-9a9b-4d6facd2efa1-tls-cert\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:18:08.413140 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.413088 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ws27\" (UniqueName: \"kubernetes.io/projected/6582a319-14f3-430f-9a9b-4d6facd2efa1-kube-api-access-8ws27\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:18:08.865804 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.865779 2575 generic.go:356] "Generic (PLEG): container finished" podID="6582a319-14f3-430f-9a9b-4d6facd2efa1" containerID="bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b" exitCode=0 Jun 08 12:18:08.866136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.865817 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b596bc74b-hdgg6" Jun 08 12:18:08.866136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.865863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b596bc74b-hdgg6" event={"ID":"6582a319-14f3-430f-9a9b-4d6facd2efa1","Type":"ContainerDied","Data":"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b"} Jun 08 12:18:08.866136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.865898 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b596bc74b-hdgg6" event={"ID":"6582a319-14f3-430f-9a9b-4d6facd2efa1","Type":"ContainerDied","Data":"1908817780f8279b9ad2da8ca8b25cf2d94e4e2e87e1f543307f904903a95c80"} Jun 08 12:18:08.866136 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.865915 2575 scope.go:117] "RemoveContainer" containerID="bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b" Jun 08 12:18:08.874637 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.874620 2575 scope.go:117] "RemoveContainer" containerID="bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b" Jun 08 12:18:08.874860 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:18:08.874843 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b\": container with ID starting with bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b not found: ID does not exist" containerID="bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b" Jun 08 12:18:08.874904 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.874866 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b"} err="failed to get container status \"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b\": rpc error: code = NotFound desc = could not find container \"bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b\": container with ID starting with bd56482f9209f0e0e6a10f5b2832d7c3e98a3ff30f5085d87033f56c4d2f876b not found: ID does not exist" Jun 08 12:18:08.899977 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.899953 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:18:08.903337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:08.903320 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b596bc74b-hdgg6"] Jun 08 12:18:09.333772 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:09.333744 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6582a319-14f3-430f-9a9b-4d6facd2efa1" path="/var/lib/kubelet/pods/6582a319-14f3-430f-9a9b-4d6facd2efa1/volumes" Jun 08 12:18:43.519492 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.519459 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg"] Jun 08 12:18:43.519870 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.519765 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6582a319-14f3-430f-9a9b-4d6facd2efa1" containerName="authorino" Jun 08 12:18:43.519870 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.519776 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6582a319-14f3-430f-9a9b-4d6facd2efa1" containerName="authorino" Jun 08 12:18:43.519870 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.519841 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6582a319-14f3-430f-9a9b-4d6facd2efa1" containerName="authorino" Jun 08 12:18:43.522782 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.522766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.526039 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.526014 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 12:18:43.526169 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.526022 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 12:18:43.527113 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.527082 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqlj7\"" Jun 08 12:18:43.527113 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.527087 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 12:18:43.546554 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.546536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg"] Jun 08 12:18:43.551398 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.551502 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea76316-4716-459c-be03-c252c2a62cb3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.551502 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnp6\" (UniqueName: \"kubernetes.io/projected/7ea76316-4716-459c-be03-c252c2a62cb3-kube-api-access-qcnp6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.551502 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.551668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.551668 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.551601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.652786 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.652895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.652895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.652895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea76316-4716-459c-be03-c252c2a62cb3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.652895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnp6\" (UniqueName: \"kubernetes.io/projected/7ea76316-4716-459c-be03-c252c2a62cb3-kube-api-access-qcnp6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.653127 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.652900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.653293 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.653274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.653349 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.653307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.653349 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.653333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.654920 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.654902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ea76316-4716-459c-be03-c252c2a62cb3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.655205 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.655186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea76316-4716-459c-be03-c252c2a62cb3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.662404 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.662381 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnp6\" (UniqueName: \"kubernetes.io/projected/7ea76316-4716-459c-be03-c252c2a62cb3-kube-api-access-qcnp6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg\" (UID: \"7ea76316-4716-459c-be03-c252c2a62cb3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.833032 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.832975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:43.978661 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:43.978634 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg"] Jun 08 12:18:43.981088 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:18:43.981063 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea76316_4716_459c_be03_c252c2a62cb3.slice/crio-5c649def92466bb7d3518f80a612b11d809ffa1a6149333104579baa2d5f0a88 WatchSource:0}: Error finding container 5c649def92466bb7d3518f80a612b11d809ffa1a6149333104579baa2d5f0a88: Status 404 returned error can't find the container with id 5c649def92466bb7d3518f80a612b11d809ffa1a6149333104579baa2d5f0a88 Jun 08 12:18:44.035095 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:44.035068 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" event={"ID":"7ea76316-4716-459c-be03-c252c2a62cb3","Type":"ContainerStarted","Data":"5c649def92466bb7d3518f80a612b11d809ffa1a6149333104579baa2d5f0a88"} Jun 08 12:18:49.065839 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:49.065796 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" event={"ID":"7ea76316-4716-459c-be03-c252c2a62cb3","Type":"ContainerStarted","Data":"97d31dc57181789c3649358e4c4789809543afed89c73b18c013f77ba5d4cb35"} Jun 08 12:18:50.072469 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:50.072436 2575 generic.go:356] "Generic (PLEG): container finished" podID="7ea76316-4716-459c-be03-c252c2a62cb3" containerID="97d31dc57181789c3649358e4c4789809543afed89c73b18c013f77ba5d4cb35" exitCode=0 Jun 08 12:18:50.072816 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:50.072525 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" event={"ID":"7ea76316-4716-459c-be03-c252c2a62cb3","Type":"ContainerDied","Data":"97d31dc57181789c3649358e4c4789809543afed89c73b18c013f77ba5d4cb35"} Jun 08 12:18:52.086213 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:52.086184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" event={"ID":"7ea76316-4716-459c-be03-c252c2a62cb3","Type":"ContainerStarted","Data":"e1e25396f5549ef712caae34490fc69aa212a02ce04e8bcc552b59623a0472ae"} Jun 08 12:18:52.110045 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:52.110003 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" podStartSLOduration=2.320379719 podStartE2EDuration="9.109989679s" totalImagesPullingTime="5.472795199s" totalInitContainerRuntime="1.316814761s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:52.107974811 +0000 UTC m=+853.267403624" watchObservedRunningTime="2026-06-08 12:18:52.109989679 +0000 UTC m=+853.269418492" Jun 08 12:18:53.833440 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:53.833405 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:53.833842 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:53.833460 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:53.845796 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:53.845770 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:54.106502 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:54.106449 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg" Jun 08 12:18:59.522722 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.522693 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9"] Jun 08 12:18:59.525758 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.525742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.530239 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.530220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 12:18:59.551042 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.551022 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9"] Jun 08 12:18:59.576921 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.576891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849da0bc-82ab-4675-9427-414c7857402b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.577019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.576930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9clv\" (UniqueName: \"kubernetes.io/projected/849da0bc-82ab-4675-9427-414c7857402b-kube-api-access-z9clv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.577019 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.576993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.577091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.577060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.577091 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.577085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.577202 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.577116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.677916 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.677891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849da0bc-82ab-4675-9427-414c7857402b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.677927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9clv\" (UniqueName: \"kubernetes.io/projected/849da0bc-82ab-4675-9427-414c7857402b-kube-api-access-z9clv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.677958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.677976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.677993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678023 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.678014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678378 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.678359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678429 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.678413 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.678461 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.678452 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.680188 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.680168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849da0bc-82ab-4675-9427-414c7857402b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.680297 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.680279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849da0bc-82ab-4675-9427-414c7857402b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.688543 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.688517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9clv\" (UniqueName: \"kubernetes.io/projected/849da0bc-82ab-4675-9427-414c7857402b-kube-api-access-z9clv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9\" (UID: \"849da0bc-82ab-4675-9427-414c7857402b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.836617 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.836563 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:18:59.973165 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:18:59.973140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9"] Jun 08 12:18:59.974742 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:18:59.974714 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849da0bc_82ab_4675_9427_414c7857402b.slice/crio-a5a0134c84ff01ea2eb48f3fa27ef28a605461b786380b89a1532672e31cff74 WatchSource:0}: Error finding container a5a0134c84ff01ea2eb48f3fa27ef28a605461b786380b89a1532672e31cff74: Status 404 returned error can't find the container with id a5a0134c84ff01ea2eb48f3fa27ef28a605461b786380b89a1532672e31cff74 Jun 08 12:19:00.124981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:00.124899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" event={"ID":"849da0bc-82ab-4675-9427-414c7857402b","Type":"ContainerStarted","Data":"a5256e9c96b7d8552150238999fa9275d17cc4a42a1c4c3e5dcb67ae6068226c"} Jun 08 12:19:00.124981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:00.124948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" event={"ID":"849da0bc-82ab-4675-9427-414c7857402b","Type":"ContainerStarted","Data":"a5a0134c84ff01ea2eb48f3fa27ef28a605461b786380b89a1532672e31cff74"} Jun 08 12:19:02.136742 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:02.136705 2575 generic.go:356] "Generic (PLEG): container finished" podID="849da0bc-82ab-4675-9427-414c7857402b" containerID="a5256e9c96b7d8552150238999fa9275d17cc4a42a1c4c3e5dcb67ae6068226c" exitCode=0 Jun 08 12:19:02.137095 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:02.136775 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" event={"ID":"849da0bc-82ab-4675-9427-414c7857402b","Type":"ContainerDied","Data":"a5256e9c96b7d8552150238999fa9275d17cc4a42a1c4c3e5dcb67ae6068226c"} Jun 08 12:19:03.143607 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:03.143580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" event={"ID":"849da0bc-82ab-4675-9427-414c7857402b","Type":"ContainerStarted","Data":"5579dd7b9f5e8135740f5d5b50715b530970b7448c9dbc2186289f5a982ecf1e"} Jun 08 12:19:03.175519 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:03.175466 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" podStartSLOduration=2.5907057399999998 podStartE2EDuration="4.175452383s" totalImagesPullingTime="359.028455ms" totalInitContainerRuntime="1.225718188s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:03.173332117 +0000 UTC m=+864.332760932" watchObservedRunningTime="2026-06-08 12:19:03.175452383 +0000 UTC m=+864.334881196" Jun 08 12:19:08.603775 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.603745 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q"] Jun 08 12:19:08.611841 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.611807 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.616793 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.616773 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 12:19:08.627686 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.627662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q"] Jun 08 12:19:08.747688 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.747779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.747779 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmfv\" (UniqueName: \"kubernetes.io/projected/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kube-api-access-tgmfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.747859 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa804dc-8264-42e9-a2f0-dce31266e7ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.747859 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.747936 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.747857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848564 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848652 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmfv\" (UniqueName: \"kubernetes.io/projected/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kube-api-access-tgmfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848652 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa804dc-8264-42e9-a2f0-dce31266e7ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848762 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848762 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848762 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.848911 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.848872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.849034 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.849015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.849146 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.849126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.850866 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.850846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa804dc-8264-42e9-a2f0-dce31266e7ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.851036 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.851018 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa804dc-8264-42e9-a2f0-dce31266e7ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.859787 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.859738 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmfv\" (UniqueName: \"kubernetes.io/projected/9aa804dc-8264-42e9-a2f0-dce31266e7ed-kube-api-access-tgmfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q\" (UID: \"9aa804dc-8264-42e9-a2f0-dce31266e7ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:08.921618 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:08.921597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:09.057884 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.057852 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q"] Jun 08 12:19:09.059381 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:19:09.059356 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa804dc_8264_42e9_a2f0_dce31266e7ed.slice/crio-3267d8eb859bf6df5dfe611017a1b61b027f25627f1de011303d8768954f3be1 WatchSource:0}: Error finding container 3267d8eb859bf6df5dfe611017a1b61b027f25627f1de011303d8768954f3be1: Status 404 returned error can't find the container with id 3267d8eb859bf6df5dfe611017a1b61b027f25627f1de011303d8768954f3be1 Jun 08 12:19:09.174794 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.174764 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" event={"ID":"9aa804dc-8264-42e9-a2f0-dce31266e7ed","Type":"ContainerStarted","Data":"fc743df61d0966de9d72f3ad329f60f59cd26959127b1fc7ee79c3decacbefc4"} Jun 08 12:19:09.174903 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.174819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" event={"ID":"9aa804dc-8264-42e9-a2f0-dce31266e7ed","Type":"ContainerStarted","Data":"3267d8eb859bf6df5dfe611017a1b61b027f25627f1de011303d8768954f3be1"} Jun 08 12:19:09.837530 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.837500 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:19:09.837945 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.837553 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:19:09.849805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:09.849781 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:19:10.192575 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:10.192548 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9" Jun 08 12:19:11.187956 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:11.187923 2575 generic.go:356] "Generic (PLEG): container finished" podID="9aa804dc-8264-42e9-a2f0-dce31266e7ed" containerID="fc743df61d0966de9d72f3ad329f60f59cd26959127b1fc7ee79c3decacbefc4" exitCode=0 Jun 08 12:19:11.188444 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:11.187995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" event={"ID":"9aa804dc-8264-42e9-a2f0-dce31266e7ed","Type":"ContainerDied","Data":"fc743df61d0966de9d72f3ad329f60f59cd26959127b1fc7ee79c3decacbefc4"} Jun 08 12:19:12.195279 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:12.195242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" event={"ID":"9aa804dc-8264-42e9-a2f0-dce31266e7ed","Type":"ContainerStarted","Data":"40b26b96b40d0aefeda0951f8f58a9debda0eb2f76d7b814091a09edfef093f9"} Jun 08 12:19:12.223015 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:12.222970 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" podStartSLOduration=2.508217668 podStartE2EDuration="4.222958153s" totalImagesPullingTime="278.402279ms" totalInitContainerRuntime="1.436338206s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:12.220840019 +0000 UTC m=+873.380268833" watchObservedRunningTime="2026-06-08 12:19:12.222958153 +0000 UTC m=+873.382386966" Jun 08 12:19:18.922304 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:18.922272 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:18.922658 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:18.922324 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:18.934337 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:18.934315 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:19:19.242401 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:19:19.242381 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q" Jun 08 12:20:33.796175 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.796139 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b8468fd57-mf9n2"] Jun 08 12:20:33.799257 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.799237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.809572 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.809551 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8468fd57-mf9n2"] Jun 08 12:20:33.893223 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.893196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtv8\" (UniqueName: \"kubernetes.io/projected/8ce438e1-b597-468f-9a90-a6c8864adae0-kube-api-access-2wtv8\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.893326 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.893229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8ce438e1-b597-468f-9a90-a6c8864adae0-oidc-ca\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.893326 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.893266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ce438e1-b597-468f-9a90-a6c8864adae0-tls-cert\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.994591 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.994568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ce438e1-b597-468f-9a90-a6c8864adae0-tls-cert\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.994675 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.994619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtv8\" (UniqueName: \"kubernetes.io/projected/8ce438e1-b597-468f-9a90-a6c8864adae0-kube-api-access-2wtv8\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.994755 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.994731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8ce438e1-b597-468f-9a90-a6c8864adae0-oidc-ca\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.995315 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.995296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8ce438e1-b597-468f-9a90-a6c8864adae0-oidc-ca\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:33.996908 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:33.996883 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ce438e1-b597-468f-9a90-a6c8864adae0-tls-cert\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:34.004937 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:34.004918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtv8\" (UniqueName: \"kubernetes.io/projected/8ce438e1-b597-468f-9a90-a6c8864adae0-kube-api-access-2wtv8\") pod \"authorino-7b8468fd57-mf9n2\" (UID: \"8ce438e1-b597-468f-9a90-a6c8864adae0\") " pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:34.108211 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:34.108165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8468fd57-mf9n2" Jun 08 12:20:34.239011 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:34.238983 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8468fd57-mf9n2"] Jun 08 12:20:34.241520 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:20:34.241482 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ce438e1_b597_468f_9a90_a6c8864adae0.slice/crio-f5ccbb0a6c042dfcb57e18c186d14b2db42572b0939a1e0332940653fc280922 WatchSource:0}: Error finding container f5ccbb0a6c042dfcb57e18c186d14b2db42572b0939a1e0332940653fc280922: Status 404 returned error can't find the container with id f5ccbb0a6c042dfcb57e18c186d14b2db42572b0939a1e0332940653fc280922 Jun 08 12:20:34.627673 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:34.627643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8468fd57-mf9n2" event={"ID":"8ce438e1-b597-468f-9a90-a6c8864adae0","Type":"ContainerStarted","Data":"f5ccbb0a6c042dfcb57e18c186d14b2db42572b0939a1e0332940653fc280922"} Jun 08 12:20:35.640353 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:35.640308 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8468fd57-mf9n2" event={"ID":"8ce438e1-b597-468f-9a90-a6c8864adae0","Type":"ContainerStarted","Data":"749bcedc4f2f30b343660c3f19ac64660e4771c0dc2b300872fd1b9127df071a"} Jun 08 12:20:35.684239 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:35.684178 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b8468fd57-mf9n2" podStartSLOduration=2.146050669 podStartE2EDuration="2.684158401s" totalImagesPullingTime="538.107732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:35.681251774 +0000 UTC m=+956.840680590" watchObservedRunningTime="2026-06-08 12:20:35.684158401 +0000 UTC m=+956.843587215" Jun 08 12:20:35.748403 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:35.748367 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:20:35.748590 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:35.748566 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-597df7d888-hnwc6" podUID="05016bac-dad6-4936-aba9-acbf45791d04" containerName="authorino" containerID="cri-o://bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8" gracePeriod=30 Jun 08 12:20:35.994538 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:35.994514 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:20:36.113864 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.113840 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert\") pod \"05016bac-dad6-4936-aba9-acbf45791d04\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " Jun 08 12:20:36.114020 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.113894 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhbn5\" (UniqueName: \"kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5\") pod \"05016bac-dad6-4936-aba9-acbf45791d04\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " Jun 08 12:20:36.114020 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.113923 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca\") pod \"05016bac-dad6-4936-aba9-acbf45791d04\" (UID: \"05016bac-dad6-4936-aba9-acbf45791d04\") " Jun 08 12:20:36.115847 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.115823 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5" (OuterVolumeSpecName: "kube-api-access-jhbn5") pod "05016bac-dad6-4936-aba9-acbf45791d04" (UID: "05016bac-dad6-4936-aba9-acbf45791d04"). InnerVolumeSpecName "kube-api-access-jhbn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:20:36.118291 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.118267 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "05016bac-dad6-4936-aba9-acbf45791d04" (UID: "05016bac-dad6-4936-aba9-acbf45791d04"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:20:36.124145 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.124124 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "05016bac-dad6-4936-aba9-acbf45791d04" (UID: "05016bac-dad6-4936-aba9-acbf45791d04"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:20:36.214820 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.214798 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhbn5\" (UniqueName: \"kubernetes.io/projected/05016bac-dad6-4936-aba9-acbf45791d04-kube-api-access-jhbn5\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:20:36.214820 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.214821 2575 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/05016bac-dad6-4936-aba9-acbf45791d04-oidc-ca\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:20:36.214981 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.214832 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/05016bac-dad6-4936-aba9-acbf45791d04-tls-cert\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:20:36.647717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.647638 2575 generic.go:356] "Generic (PLEG): container finished" podID="05016bac-dad6-4936-aba9-acbf45791d04" containerID="bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8" exitCode=0 Jun 08 12:20:36.647717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.647680 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597df7d888-hnwc6" Jun 08 12:20:36.647717 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.647680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597df7d888-hnwc6" event={"ID":"05016bac-dad6-4936-aba9-acbf45791d04","Type":"ContainerDied","Data":"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8"} Jun 08 12:20:36.648242 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.647729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597df7d888-hnwc6" event={"ID":"05016bac-dad6-4936-aba9-acbf45791d04","Type":"ContainerDied","Data":"10aad6a51e1615454ece5c82a95d3deaa612ac737f7a147bc6fad24fdc4d2845"} Jun 08 12:20:36.648242 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.647747 2575 scope.go:117] "RemoveContainer" containerID="bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8" Jun 08 12:20:36.657348 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.657330 2575 scope.go:117] "RemoveContainer" containerID="bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8" Jun 08 12:20:36.657581 ip-10-0-132-69 kubenswrapper[2575]: E0608 12:20:36.657564 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8\": container with ID starting with bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8 not found: ID does not exist" containerID="bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8" Jun 08 12:20:36.657633 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.657591 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8"} err="failed to get container status \"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8\": rpc error: code = NotFound desc = could not find container \"bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8\": container with ID starting with bd5bbb2049426b31e365a819c98bdf28b613cbd7c96f3bcafef917aa55c13ef8 not found: ID does not exist" Jun 08 12:20:36.700714 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.700692 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:20:36.713782 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:36.713757 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-597df7d888-hnwc6"] Jun 08 12:20:37.327589 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:20:37.327559 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05016bac-dad6-4936-aba9-acbf45791d04" path="/var/lib/kubelet/pods/05016bac-dad6-4936-aba9-acbf45791d04/volumes" Jun 08 12:22:13.914205 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:13.914171 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:22:13.914719 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:13.914399 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" podUID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" containerName="manager" containerID="cri-o://238d3504f6a99d60ef2d07f35c308b123cde2ead1530392ffb2bf287287c654b" gracePeriod=30 Jun 08 12:22:14.165549 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.165478 2575 generic.go:356] "Generic (PLEG): container finished" podID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" containerID="238d3504f6a99d60ef2d07f35c308b123cde2ead1530392ffb2bf287287c654b" exitCode=0 Jun 08 12:22:14.165664 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.165552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" event={"ID":"d4723a54-985e-45c7-b7b6-0a1baf995ffd","Type":"ContainerDied","Data":"238d3504f6a99d60ef2d07f35c308b123cde2ead1530392ffb2bf287287c654b"} Jun 08 12:22:14.165664 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.165617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" event={"ID":"d4723a54-985e-45c7-b7b6-0a1baf995ffd","Type":"ContainerDied","Data":"6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576"} Jun 08 12:22:14.165664 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.165634 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6caa366296db5b911977feccc6ea19ff1788c9f0d3998dbff2dc7f60f133d576" Jun 08 12:22:14.166683 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.166666 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:22:14.338389 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.338348 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rmrr\" (UniqueName: \"kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr\") pod \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " Jun 08 12:22:14.338608 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.338405 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert\") pod \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\" (UID: \"d4723a54-985e-45c7-b7b6-0a1baf995ffd\") " Jun 08 12:22:14.340411 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.340385 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d4723a54-985e-45c7-b7b6-0a1baf995ffd" (UID: "d4723a54-985e-45c7-b7b6-0a1baf995ffd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:22:14.340411 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.340403 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr" (OuterVolumeSpecName: "kube-api-access-6rmrr") pod "d4723a54-985e-45c7-b7b6-0a1baf995ffd" (UID: "d4723a54-985e-45c7-b7b6-0a1baf995ffd"). InnerVolumeSpecName "kube-api-access-6rmrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:22:14.439901 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.439879 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rmrr\" (UniqueName: \"kubernetes.io/projected/d4723a54-985e-45c7-b7b6-0a1baf995ffd-kube-api-access-6rmrr\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:22:14.439901 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:14.439901 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4723a54-985e-45c7-b7b6-0a1baf995ffd-webhook-cert\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:22:15.170203 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:15.170172 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-2475m" Jun 08 12:22:15.204683 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:15.204658 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:22:15.217534 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:15.217511 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-2475m"] Jun 08 12:22:15.326682 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:15.326660 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" path="/var/lib/kubelet/pods/d4723a54-985e-45c7-b7b6-0a1baf995ffd/volumes" Jun 08 12:22:16.004742 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.004707 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-p4pgt"] Jun 08 12:22:16.005033 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005020 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" containerName="manager" Jun 08 12:22:16.005082 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005035 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" containerName="manager" Jun 08 12:22:16.005082 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005054 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05016bac-dad6-4936-aba9-acbf45791d04" containerName="authorino" Jun 08 12:22:16.005082 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005060 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05016bac-dad6-4936-aba9-acbf45791d04" containerName="authorino" Jun 08 12:22:16.005194 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005136 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4723a54-985e-45c7-b7b6-0a1baf995ffd" containerName="manager" Jun 08 12:22:16.005194 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.005143 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05016bac-dad6-4936-aba9-acbf45791d04" containerName="authorino" Jun 08 12:22:16.008190 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.008171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.010965 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.010947 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 12:22:16.011117 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.011088 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 12:22:16.012140 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.012123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v9pq\"" Jun 08 12:22:16.021420 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.021401 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-p4pgt"] Jun 08 12:22:16.154342 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.154318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x967q\" (UniqueName: \"kubernetes.io/projected/54431372-4029-4c7d-8fcb-da8600c65937-kube-api-access-x967q\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.154456 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.154358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54431372-4029-4c7d-8fcb-da8600c65937-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.255653 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.255580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x967q\" (UniqueName: \"kubernetes.io/projected/54431372-4029-4c7d-8fcb-da8600c65937-kube-api-access-x967q\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.255947 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.255687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54431372-4029-4c7d-8fcb-da8600c65937-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.258065 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.258040 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54431372-4029-4c7d-8fcb-da8600c65937-webhook-cert\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.266190 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.266165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x967q\" (UniqueName: \"kubernetes.io/projected/54431372-4029-4c7d-8fcb-da8600c65937-kube-api-access-x967q\") pod \"maas-controller-7bf6cb8f9f-p4pgt\" (UID: \"54431372-4029-4c7d-8fcb-da8600c65937\") " pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.318067 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.318044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:16.453900 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.453877 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf6cb8f9f-p4pgt"] Jun 08 12:22:16.456126 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:22:16.456088 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54431372_4029_4c7d_8fcb_da8600c65937.slice/crio-0215c07ded6e8bc210fe3a438d9d91ff191e940df6318709af73e90c52b53d36 WatchSource:0}: Error finding container 0215c07ded6e8bc210fe3a438d9d91ff191e940df6318709af73e90c52b53d36: Status 404 returned error can't find the container with id 0215c07ded6e8bc210fe3a438d9d91ff191e940df6318709af73e90c52b53d36 Jun 08 12:22:16.457451 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:16.457430 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:22:17.182502 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:17.182470 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" event={"ID":"54431372-4029-4c7d-8fcb-da8600c65937","Type":"ContainerStarted","Data":"0215c07ded6e8bc210fe3a438d9d91ff191e940df6318709af73e90c52b53d36"} Jun 08 12:22:18.189495 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:18.189460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" event={"ID":"54431372-4029-4c7d-8fcb-da8600c65937","Type":"ContainerStarted","Data":"a0855ccff02138c9a61e9d3c2857c7121ade2246a24383417e3b32f61e347037"} Jun 08 12:22:18.189882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:18.189544 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:22:18.212755 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:18.212708 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" podStartSLOduration=2.329651033 podStartE2EDuration="3.212696623s" totalImagesPullingTime="883.04559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:22:18.212557372 +0000 UTC m=+1059.371986215" watchObservedRunningTime="2026-06-08 12:22:18.212696623 +0000 UTC m=+1059.372125443" Jun 08 12:22:29.201488 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:22:29.201412 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf6cb8f9f-p4pgt" Jun 08 12:23:39.455594 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:23:39.455562 2575 scope.go:117] "RemoveContainer" containerID="238d3504f6a99d60ef2d07f35c308b123cde2ead1530392ffb2bf287287c654b" Jun 08 12:30:00.143197 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.143124 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29682030-jhnp6"] Jun 08 12:30:00.145970 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.145955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:00.148689 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.148669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nw77s\"" Jun 08 12:30:00.164306 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.164283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682030-jhnp6"] Jun 08 12:30:00.254775 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.254745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57hmx\" (UniqueName: \"kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx\") pod \"maas-api-key-cleanup-29682030-jhnp6\" (UID: \"7ec59374-1882-4158-b0ae-cbe910572b10\") " pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:00.355815 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.355778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57hmx\" (UniqueName: \"kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx\") pod \"maas-api-key-cleanup-29682030-jhnp6\" (UID: \"7ec59374-1882-4158-b0ae-cbe910572b10\") " pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:00.365028 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.365000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57hmx\" (UniqueName: \"kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx\") pod \"maas-api-key-cleanup-29682030-jhnp6\" (UID: \"7ec59374-1882-4158-b0ae-cbe910572b10\") " pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:00.455730 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.455708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:00.585645 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.585622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682030-jhnp6"] Jun 08 12:30:00.587725 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:30:00.587698 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec59374_1882_4158_b0ae_cbe910572b10.slice/crio-59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5 WatchSource:0}: Error finding container 59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5: Status 404 returned error can't find the container with id 59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5 Jun 08 12:30:00.589537 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:00.589521 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:30:01.567167 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:01.567131 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" event={"ID":"7ec59374-1882-4158-b0ae-cbe910572b10","Type":"ContainerStarted","Data":"59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5"} Jun 08 12:30:07.605426 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:07.605343 2575 generic.go:356] "Generic (PLEG): container finished" podID="7ec59374-1882-4158-b0ae-cbe910572b10" containerID="3fef682333fbbca92960d37dbdf9b329323cfa2db1bd1d1bca5f2ad682a979e4" exitCode=0 Jun 08 12:30:07.605426 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:07.605403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" event={"ID":"7ec59374-1882-4158-b0ae-cbe910572b10","Type":"ContainerDied","Data":"3fef682333fbbca92960d37dbdf9b329323cfa2db1bd1d1bca5f2ad682a979e4"} Jun 08 12:30:08.739597 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:08.739573 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:08.833138 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:08.833088 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57hmx\" (UniqueName: \"kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx\") pod \"7ec59374-1882-4158-b0ae-cbe910572b10\" (UID: \"7ec59374-1882-4158-b0ae-cbe910572b10\") " Jun 08 12:30:08.835021 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:08.834997 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx" (OuterVolumeSpecName: "kube-api-access-57hmx") pod "7ec59374-1882-4158-b0ae-cbe910572b10" (UID: "7ec59374-1882-4158-b0ae-cbe910572b10"). InnerVolumeSpecName "kube-api-access-57hmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:30:08.934562 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:08.934539 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57hmx\" (UniqueName: \"kubernetes.io/projected/7ec59374-1882-4158-b0ae-cbe910572b10-kube-api-access-57hmx\") on node \"ip-10-0-132-69.ec2.internal\" DevicePath \"\"" Jun 08 12:30:09.616883 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:09.616813 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" event={"ID":"7ec59374-1882-4158-b0ae-cbe910572b10","Type":"ContainerDied","Data":"59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5"} Jun 08 12:30:09.616883 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:09.616837 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682030-jhnp6" Jun 08 12:30:09.616883 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:30:09.616862 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59425929c25478b806e151264f413463ce1804c7b2314766e4953aaef5e3e3e5" Jun 08 12:43:01.476945 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:01.476915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8468fd57-mf9n2_8ce438e1-b597-468f-9a90-a6c8864adae0/authorino/0.log" Jun 08 12:43:06.602208 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:06.602180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682030-jhnp6_7ec59374-1882-4158-b0ae-cbe910572b10/cleanup/0.log" Jun 08 12:43:06.719835 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:06.719812 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf6cb8f9f-p4pgt_54431372-4029-4c7d-8fcb-da8600c65937/manager/0.log" Jun 08 12:43:06.949853 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:06.949832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-grkvf_a05034ab-a0d2-4a4d-a02d-a1f81e11efdf/manager/0.log" Jun 08 12:43:07.300300 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:07.300230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-sqj8j_add7ae8b-58e4-45f1-8c3c-900d44aa9668/copy-manifests/0.log" Jun 08 12:43:07.316137 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:07.316117 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-sqj8j_add7ae8b-58e4-45f1-8c3c-900d44aa9668/manager/0.log" Jun 08 12:43:08.191127 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.191076 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/util/0.log" Jun 08 12:43:08.197427 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.197407 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/pull/0.log" Jun 08 12:43:08.204135 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.204098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/extract/0.log" Jun 08 12:43:08.316063 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.316025 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/extract/0.log" Jun 08 12:43:08.323895 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.323878 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/util/0.log" Jun 08 12:43:08.331235 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.331218 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/pull/0.log" Jun 08 12:43:08.443184 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.443129 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/util/0.log" Jun 08 12:43:08.449951 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.449928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/pull/0.log" Jun 08 12:43:08.456096 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.456076 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/extract/0.log" Jun 08 12:43:08.565111 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.565091 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/util/0.log" Jun 08 12:43:08.571277 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.571254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/pull/0.log" Jun 08 12:43:08.577096 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.577081 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/extract/0.log" Jun 08 12:43:08.698362 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:08.698312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8468fd57-mf9n2_8ce438e1-b597-468f-9a90-a6c8864adae0/authorino/0.log" Jun 08 12:43:09.053831 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:09.053774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-52lkx_7b6cca88-ff30-490e-b3db-03931f7f7f0b/kuadrant-console-plugin/0.log" Jun 08 12:43:10.239706 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:10.239679 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54b6f995bf-v46ps_ff6048d9-4d14-4434-8bce-8f0ecb23949b/kube-auth-proxy/0.log" Jun 08 12:43:10.480282 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:10.480251 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xwc9w_f2fafa1e-3ffc-49f3-85f8-d42a0a01b946/payload-pre-processing/0.log" Jun 08 12:43:10.604680 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:10.604607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-j7hkq_2ad85e35-1396-457a-876a-8f5c178417f3/payload-processing/0.log" Jun 08 12:43:11.068494 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.068468 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg_7ea76316-4716-459c-be03-c252c2a62cb3/storage-initializer/0.log" Jun 08 12:43:11.077531 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.077510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vxnzg_7ea76316-4716-459c-be03-c252c2a62cb3/main/0.log" Jun 08 12:43:11.300879 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.300857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9_849da0bc-82ab-4675-9427-414c7857402b/storage-initializer/0.log" Jun 08 12:43:11.308132 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.308096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-84fj9_849da0bc-82ab-4675-9427-414c7857402b/main/0.log" Jun 08 12:43:11.419796 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.419746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q_9aa804dc-8264-42e9-a2f0-dce31266e7ed/storage-initializer/0.log" Jun 08 12:43:11.426719 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:11.426703 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ccwz2q_9aa804dc-8264-42e9-a2f0-dce31266e7ed/main/0.log" Jun 08 12:43:19.486624 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:19.486594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v7swr_c06b5b67-d121-4e4f-9fcc-9161f9f8defc/global-pull-secret-syncer/0.log" Jun 08 12:43:19.621188 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:19.621158 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sxhhm_9bfb07ff-ffa8-4a44-9436-f5fb81775a23/konnectivity-agent/0.log" Jun 08 12:43:19.644849 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:19.644828 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-69.ec2.internal_34104b1ff5ad84f1a4b34f9808ccb83e/haproxy/0.log" Jun 08 12:43:24.235216 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.235187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/extract/0.log" Jun 08 12:43:24.265691 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.265668 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/util/0.log" Jun 08 12:43:24.292473 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.292454 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598lt4q_8c12218e-0d17-43a1-9f73-8922c31e0300/pull/0.log" Jun 08 12:43:24.323041 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.323015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/extract/0.log" Jun 08 12:43:24.346596 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.346579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/util/0.log" Jun 08 12:43:24.371147 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.371129 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rntsr_ea633f57-d999-4a15-b9a4-7636932ebe06/pull/0.log" Jun 08 12:43:24.401165 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.401147 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/extract/0.log" Jun 08 12:43:24.427268 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.427243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/util/0.log" Jun 08 12:43:24.454645 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.454620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dk5s7_59475328-e19b-47e8-858c-adc3ae17267a/pull/0.log" Jun 08 12:43:24.496982 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.496843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/extract/0.log" Jun 08 12:43:24.533329 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.533305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/util/0.log" Jun 08 12:43:24.556288 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.556272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jvr4_fddfca1b-c3e2-43e4-ab1a-2fc8f8d4d081/pull/0.log" Jun 08 12:43:24.714790 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.714764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8468fd57-mf9n2_8ce438e1-b597-468f-9a90-a6c8864adae0/authorino/0.log" Jun 08 12:43:24.815471 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:24.815400 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-52lkx_7b6cca88-ff30-490e-b3db-03931f7f7f0b/kuadrant-console-plugin/0.log" Jun 08 12:43:26.586359 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.586332 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/alertmanager/0.log" Jun 08 12:43:26.611733 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.611696 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/config-reloader/0.log" Jun 08 12:43:26.636805 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.636780 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/kube-rbac-proxy-web/0.log" Jun 08 12:43:26.663503 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.663486 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/kube-rbac-proxy/0.log" Jun 08 12:43:26.692407 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.692383 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/kube-rbac-proxy-metric/0.log" Jun 08 12:43:26.717390 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.717364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/prom-label-proxy/0.log" Jun 08 12:43:26.743062 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:26.743045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a6bc1bf6-582f-48b2-9c84-8941e66a787d/init-config-reloader/0.log" Jun 08 12:43:27.207882 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.207855 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rk84n_506e7f70-72e7-44f4-918e-cf69bf84df70/node-exporter/0.log" Jun 08 12:43:27.240558 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.240504 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rk84n_506e7f70-72e7-44f4-918e-cf69bf84df70/kube-rbac-proxy/0.log" Jun 08 12:43:27.288615 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.288593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rk84n_506e7f70-72e7-44f4-918e-cf69bf84df70/init-textfile/0.log" Jun 08 12:43:27.338907 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.338886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p4rwn_7f6fcc68-0129-496d-9ddc-1c7b02134eac/kube-rbac-proxy-main/0.log" Jun 08 12:43:27.369904 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.369886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p4rwn_7f6fcc68-0129-496d-9ddc-1c7b02134eac/kube-rbac-proxy-self/0.log" Jun 08 12:43:27.401042 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:27.401023 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p4rwn_7f6fcc68-0129-496d-9ddc-1c7b02134eac/openshift-state-metrics/0.log" Jun 08 12:43:30.518222 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.518146 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz"] Jun 08 12:43:30.518565 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.518489 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec59374-1882-4158-b0ae-cbe910572b10" containerName="cleanup" Jun 08 12:43:30.518565 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.518500 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec59374-1882-4158-b0ae-cbe910572b10" containerName="cleanup" Jun 08 12:43:30.518565 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.518556 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec59374-1882-4158-b0ae-cbe910572b10" containerName="cleanup" Jun 08 12:43:30.521393 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.521377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.523967 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.523942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wz44x\"/\"default-dockercfg-756qk\"" Jun 08 12:43:30.523967 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.523968 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz44x\"/\"openshift-service-ca.crt\"" Jun 08 12:43:30.525081 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.525063 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz44x\"/\"kube-root-ca.crt\"" Jun 08 12:43:30.530117 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.530081 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz"] Jun 08 12:43:30.654481 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.654454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-proc\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.654586 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.654495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5srzm\" (UniqueName: \"kubernetes.io/projected/19387619-770c-453a-b4b4-ccf75bb1060e-kube-api-access-5srzm\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.654586 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.654530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-lib-modules\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.654586 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.654571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-podres\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.654694 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.654594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-sys\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755418 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-lib-modules\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755580 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-podres\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755580 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-sys\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755580 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-proc\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755580 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755559 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-lib-modules\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755580 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5srzm\" (UniqueName: \"kubernetes.io/projected/19387619-770c-453a-b4b4-ccf75bb1060e-kube-api-access-5srzm\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755841 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755578 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-sys\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755841 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755603 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-podres\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.755841 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.755625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19387619-770c-453a-b4b4-ccf75bb1060e-proc\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.764300 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.764280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5srzm\" (UniqueName: \"kubernetes.io/projected/19387619-770c-453a-b4b4-ccf75bb1060e-kube-api-access-5srzm\") pod \"perf-node-gather-daemonset-dk9hz\" (UID: \"19387619-770c-453a-b4b4-ccf75bb1060e\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.831777 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.831721 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:30.961094 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:30.961071 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz"] Jun 08 12:43:30.963580 ip-10-0-132-69 kubenswrapper[2575]: W0608 12:43:30.963548 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19387619_770c_453a_b4b4_ccf75bb1060e.slice/crio-537d09190ee5f9082969aa0e37979006bf4d312a23417c3a1a9ca144337a2f9d WatchSource:0}: Error finding container 537d09190ee5f9082969aa0e37979006bf4d312a23417c3a1a9ca144337a2f9d: Status 404 returned error can't find the container with id 537d09190ee5f9082969aa0e37979006bf4d312a23417c3a1a9ca144337a2f9d Jun 08 12:43:31.795855 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:31.795816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" event={"ID":"19387619-770c-453a-b4b4-ccf75bb1060e","Type":"ContainerStarted","Data":"5a04f4ea02c3d9231c54785e47e7f1924f6216df7314ad91fe872a57e1a4ebb4"} Jun 08 12:43:31.796253 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:31.795870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" event={"ID":"19387619-770c-453a-b4b4-ccf75bb1060e","Type":"ContainerStarted","Data":"537d09190ee5f9082969aa0e37979006bf4d312a23417c3a1a9ca144337a2f9d"} Jun 08 12:43:31.796253 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:31.795890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:31.814064 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:31.814017 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" podStartSLOduration=1.81400351 podStartE2EDuration="1.81400351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:43:31.813377592 +0000 UTC m=+2332.972806407" watchObservedRunningTime="2026-06-08 12:43:31.81400351 +0000 UTC m=+2332.973432367" Jun 08 12:43:32.367062 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:32.367039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x29n_5188f961-40a6-4f73-a72b-393c254a714c/dns/0.log" Jun 08 12:43:32.390999 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:32.390977 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x29n_5188f961-40a6-4f73-a72b-393c254a714c/kube-rbac-proxy/0.log" Jun 08 12:43:32.519277 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:32.519245 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktzqj_03bef4ca-9b00-461d-9bc4-7994d49b7873/dns-node-resolver/0.log" Jun 08 12:43:33.109230 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:33.109201 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-689544c4b9-jlkzq_579109ab-dfc3-46f1-be79-ae6ed7639e56/registry/0.log" Jun 08 12:43:33.117069 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:33.117040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-689544c4b9-jlkzq_579109ab-dfc3-46f1-be79-ae6ed7639e56/registry/1.log" Jun 08 12:43:33.165677 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:33.165658 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njjnk_ed1d36e8-776e-4c3a-8449-608ecf55edf9/node-ca/0.log" Jun 08 12:43:34.333389 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:34.333362 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54b6f995bf-v46ps_ff6048d9-4d14-4434-8bce-8f0ecb23949b/kube-auth-proxy/0.log" Jun 08 12:43:34.480470 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:34.480440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xwc9w_f2fafa1e-3ffc-49f3-85f8-d42a0a01b946/payload-pre-processing/0.log" Jun 08 12:43:34.539928 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:34.539900 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-j7hkq_2ad85e35-1396-457a-876a-8f5c178417f3/payload-processing/0.log" Jun 08 12:43:35.208677 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:35.208646 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-grctn_6825ab2c-f39b-43b2-a676-cc2804c6d53a/serve-healthcheck-canary/0.log" Jun 08 12:43:35.992780 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:35.992750 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smmnl_2617dcf9-d4ff-49a5-b383-2bc2547111dd/kube-rbac-proxy/0.log" Jun 08 12:43:36.018749 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:36.018723 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smmnl_2617dcf9-d4ff-49a5-b383-2bc2547111dd/exporter/0.log" Jun 08 12:43:36.043610 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:36.043590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smmnl_2617dcf9-d4ff-49a5-b383-2bc2547111dd/extractor/0.log" Jun 08 12:43:37.812637 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:37.812612 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-dk9hz" Jun 08 12:43:38.593962 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:38.593936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682030-jhnp6_7ec59374-1882-4158-b0ae-cbe910572b10/cleanup/0.log" Jun 08 12:43:38.666623 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:38.666601 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf6cb8f9f-p4pgt_54431372-4029-4c7d-8fcb-da8600c65937/manager/0.log" Jun 08 12:43:38.744884 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:38.744866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-grkvf_a05034ab-a0d2-4a4d-a02d-a1f81e11efdf/manager/0.log" Jun 08 12:43:38.954443 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:38.954420 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-sqj8j_add7ae8b-58e4-45f1-8c3c-900d44aa9668/manager/0.log" Jun 08 12:43:38.981438 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:38.981419 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-sqj8j_add7ae8b-58e4-45f1-8c3c-900d44aa9668/copy-manifests/0.log" Jun 08 12:43:40.788786 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:40.788755 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59f754cb69-ldg5t_3a3678b8-acab-4ace-b330-258108546ea0/manager/0.log" Jun 08 12:43:40.878768 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:40.878741 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-c24hh_9f342e10-72bc-41b4-a975-bb7fe5fa939b/openshift-lws-operator/0.log" Jun 08 12:43:43.967870 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:43.967838 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54b6f995bf-v46ps_ff6048d9-4d14-4434-8bce-8f0ecb23949b/kube-auth-proxy/0.log" Jun 08 12:43:44.076370 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:44.076342 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xwc9w_f2fafa1e-3ffc-49f3-85f8-d42a0a01b946/payload-pre-processing/0.log" Jun 08 12:43:44.133073 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:44.133047 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-j7hkq_2ad85e35-1396-457a-876a-8f5c178417f3/payload-processing/0.log" Jun 08 12:43:45.353569 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:45.353544 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54b6f995bf-v46ps_ff6048d9-4d14-4434-8bce-8f0ecb23949b/kube-auth-proxy/0.log" Jun 08 12:43:45.471535 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:45.471509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xwc9w_f2fafa1e-3ffc-49f3-85f8-d42a0a01b946/payload-pre-processing/0.log" Jun 08 12:43:45.519013 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:45.518990 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-j7hkq_2ad85e35-1396-457a-876a-8f5c178417f3/payload-processing/0.log" Jun 08 12:43:47.467672 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:47.467644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54b6f995bf-v46ps_ff6048d9-4d14-4434-8bce-8f0ecb23949b/kube-auth-proxy/0.log" Jun 08 12:43:47.587177 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:47.587153 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xwc9w_f2fafa1e-3ffc-49f3-85f8-d42a0a01b946/payload-pre-processing/0.log" Jun 08 12:43:47.637829 ip-10-0-132-69 kubenswrapper[2575]: I0608 12:43:47.637807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-j7hkq_2ad85e35-1396-457a-876a-8f5c178417f3/payload-processing/0.log"