May 29 00:47:15.213025 ip-10-0-140-228 systemd[1]: Starting Kubernetes Kubelet... May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.798288 2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804229 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804239 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804243 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804246 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804249 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804253 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804256 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:15.894418 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804260 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804263 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804266 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804268 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804271 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804273 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804276 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804278 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804281 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804283 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804286 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804288 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804291 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804294 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804296 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804299 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804302 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804304 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804307 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804311 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:15.895137 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804314 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804316 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804319 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804322 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804324 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804327 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804330 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804333 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804336 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804338 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804341 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804343 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804347 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804351 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804354 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804356 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804359 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804361 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804365 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:15.895600 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804368 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804370 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804373 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804375 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804378 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804380 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804383 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804386 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804388 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804391 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804394 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804397 2570 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804400 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804403 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804405 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804408 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804412 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804414 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804417 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804419 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:15.896077 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804421 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804424 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804427 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804429 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804432 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804435 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804437 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804440 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804444 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804447 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804450 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804453 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804455 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804458 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804461 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804463 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804466 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804468 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804471 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:15.896551 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804473 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804843 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804849 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804853 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804855 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804858 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804861 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804863 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804866 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804869 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804872 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804874 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804877 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804879 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804882 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804885 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804887 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804889 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804892 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804895 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:15.897112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804898 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804901 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804904 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804906 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804909 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804911 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804914 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804917 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804919 2570 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804922 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804925 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804927 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804930 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804932 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804935 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804938 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804940 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804942 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804946 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804948 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:15.897832 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804951 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804953 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804956 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804958 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804961 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804963 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804966 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804969 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804971 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804974 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804976 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804979 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804982 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804984 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804987 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804989 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804991 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804994 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.804998 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:15.898514 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805001 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805004 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805011 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805014 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805016 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805019 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805022 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805024 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805027 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805029 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805032 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805035 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805038 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805041 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805043 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805046 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805048 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805052 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805054 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:15.899072 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805057 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805059 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805062 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805064 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805067 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805070 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805072 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805075 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805077 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805148 2570 flags.go:64] FLAG: --address="0.0.0.0" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805154 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805160 2570 flags.go:64] FLAG: --anonymous-auth="true" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805164 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805168 2570 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805171 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805176 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805181 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805184 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805187 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805190 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805194 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805197 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 00:47:15.899672 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805200 2570 flags.go:64] FLAG: --cgroup-root="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805202 2570 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805205 2570 flags.go:64] FLAG: --client-ca-file="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805208 2570 flags.go:64] FLAG: --cloud-config="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805211 2570 flags.go:64] FLAG: --cloud-provider="external" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805214 2570 flags.go:64] FLAG: --cluster-dns="[]" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805218 2570 flags.go:64] FLAG: --cluster-domain="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805221 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805224 2570 flags.go:64] FLAG: --config-dir="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805227 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805230 2570 flags.go:64] FLAG: --container-log-max-files="5" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805234 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805237 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805240 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805243 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805246 2570 flags.go:64] FLAG: --contention-profiling="false" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805249 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805252 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805256 2570 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805258 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805262 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805265 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805268 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805271 2570 flags.go:64] FLAG: --enable-load-reader="false" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805274 2570 flags.go:64] FLAG: --enable-server="true" May 29 00:47:15.900387 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805277 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805282 2570 flags.go:64] FLAG: --event-burst="100" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805285 2570 flags.go:64] FLAG: --event-qps="50" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805288 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805291 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805294 2570 flags.go:64] FLAG: --eviction-hard="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805297 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805300 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805303 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805306 2570 flags.go:64] FLAG: --eviction-soft="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805308 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805311 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805314 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805317 2570 flags.go:64] FLAG: --experimental-mounter-path="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805320 2570 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805323 2570 flags.go:64] FLAG: --fail-swap-on="true" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805326 2570 flags.go:64] FLAG: --feature-gates="" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805329 2570 flags.go:64] FLAG: --file-check-frequency="20s" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805332 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805335 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805338 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805342 2570 flags.go:64] FLAG: --healthz-port="10248" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805345 2570 flags.go:64] FLAG: --help="false" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805348 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-140-228.ec2.internal" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805351 2570 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 00:47:15.901180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805354 2570 flags.go:64] FLAG: --http-check-frequency="20s" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805357 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805360 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805363 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805366 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805368 2570 flags.go:64] FLAG: --image-service-endpoint="" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805371 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805376 2570 flags.go:64] FLAG: --kube-api-burst="100" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805379 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805382 2570 flags.go:64] FLAG: --kube-api-qps="50" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805385 2570 flags.go:64] FLAG: --kube-reserved="" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805388 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805392 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805395 2570 flags.go:64] FLAG: --kubelet-cgroups="" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805398 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805400 2570 flags.go:64] FLAG: --lock-file="" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805403 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805406 2570 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805409 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805414 2570 flags.go:64] FLAG: --log-json-split-stream="false" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805417 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805420 2570 flags.go:64] FLAG: --log-text-split-stream="false" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805422 2570 flags.go:64] FLAG: --logging-format="text" May 29 00:47:15.901803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805425 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805429 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805432 2570 flags.go:64] FLAG: --manifest-url="" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805434 2570 flags.go:64] FLAG: --manifest-url-header="" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805438 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805441 2570 flags.go:64] FLAG: --max-open-files="1000000" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805446 2570 flags.go:64] FLAG: --max-pods="110" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805449 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805452 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805454 2570 flags.go:64] FLAG: --memory-manager-policy="None" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805457 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805460 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805463 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805466 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805473 2570 flags.go:64] FLAG: --node-status-max-images="50" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805476 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805480 2570 flags.go:64] FLAG: --oom-score-adj="-999" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805483 2570 flags.go:64] FLAG: --pod-cidr="" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805486 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805491 2570 flags.go:64] FLAG: --pod-manifest-path="" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805494 2570 flags.go:64] FLAG: --pod-max-pids="-1" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805501 2570 flags.go:64] FLAG: --pods-per-core="0" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805504 2570 flags.go:64] FLAG: --port="10250" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805507 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 00:47:15.902372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805510 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e2b9fb954bef43ff" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805513 2570 flags.go:64] FLAG: --qos-reserved="" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805516 2570 flags.go:64] FLAG: --read-only-port="10255" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805519 2570 flags.go:64] FLAG: --register-node="true" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805522 2570 flags.go:64] FLAG: --register-schedulable="true" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805525 2570 flags.go:64] FLAG: --register-with-taints="" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805528 2570 flags.go:64] FLAG: --registry-burst="10" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805531 2570 flags.go:64] FLAG: --registry-qps="5" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805534 2570 flags.go:64] FLAG: --reserved-cpus="" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805536 2570 flags.go:64] FLAG: --reserved-memory="" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805540 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805543 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805546 2570 flags.go:64] FLAG: --rotate-certificates="false" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805549 2570 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805551 2570 flags.go:64] FLAG: --runonce="false" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805555 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805558 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805560 2570 flags.go:64] FLAG: --seccomp-default="false" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805564 2570 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805566 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805569 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805572 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805575 2570 flags.go:64] FLAG: --storage-driver-password="root" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805578 2570 flags.go:64] FLAG: --storage-driver-secure="false" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805581 2570 flags.go:64] FLAG: --storage-driver-table="stats" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805585 2570 flags.go:64] FLAG: --storage-driver-user="root" May 29 00:47:15.902956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805587 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805590 2570 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805593 2570 flags.go:64] FLAG: --system-cgroups="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805597 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805603 2570 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805605 2570 flags.go:64] FLAG: --tls-cert-file="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805608 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805611 2570 flags.go:64] FLAG: --tls-min-version="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805614 2570 flags.go:64] FLAG: --tls-private-key-file="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805617 2570 flags.go:64] FLAG: --topology-manager-policy="none" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805620 2570 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805623 2570 flags.go:64] FLAG: --topology-manager-scope="container" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805626 2570 flags.go:64] FLAG: --v="2" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805629 2570 flags.go:64] FLAG: --version="false" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805633 2570 flags.go:64] FLAG: --vmodule="" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805637 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.805640 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805721 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805724 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805726 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805729 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805732 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805735 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:15.903607 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805737 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805740 2570 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805743 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805746 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805749 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805753 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805756 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805759 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805763 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805766 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805769 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805786 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805790 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805793 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805796 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805799 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805802 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805804 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805807 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805810 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:15.904170 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805812 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805815 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805818 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805820 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805823 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805826 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805828 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805831 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805833 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805836 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805838 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805841 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805844 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805846 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805849 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805851 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805854 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805856 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805859 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805861 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:15.904699 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805865 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805867 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805870 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805872 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805877 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805879 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805882 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805885 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805887 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805890 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805892 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805895 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805897 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805900 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805902 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805906 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805909 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805912 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805915 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:15.905206 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805917 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805919 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805922 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805924 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805927 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805930 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805933 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805935 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805938 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805940 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805943 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805945 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805948 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805951 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805954 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805956 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805959 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805963 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805965 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805968 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:15.905658 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.805971 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.806796 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.814027 2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.814042 2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814090 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814095 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814098 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814102 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814105 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814108 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814111 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814114 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814117 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814120 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814122 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814125 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:15.906160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814127 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814130 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814133 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814135 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814138 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814140 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814143 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814146 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814149 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814152 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814154 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814157 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814160 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814162 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814165 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814167 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814170 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814173 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814175 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814179 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:15.906566 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814182 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814184 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814187 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814190 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814192 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814195 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814198 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814200 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814203 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814206 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814208 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814211 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814213 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814216 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814219 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814222 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814225 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814227 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814230 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814232 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:15.907107 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814235 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814237 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814240 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814242 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814245 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814247 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814250 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814252 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814255 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814258 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814260 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814264 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814267 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814269 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814272 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814274 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814277 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814280 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814283 2570 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814285 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:15.907585 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814288 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814291 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814295 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814299 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814303 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814306 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814309 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814312 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814314 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814317 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814320 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814323 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814326 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814330 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.814335 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:15.908093 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814427 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814431 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814434 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814437 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814440 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814443 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814446 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814449 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814451 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814457 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814460 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814462 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814465 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814468 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814471 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814473 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814476 2570 feature_gate.go:328] unrecognized feature gate: Example May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814478 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814481 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814484 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 00:47:15.908465 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814487 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814489 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814493 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814495 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814498 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814500 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814503 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814506 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814509 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814511 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814514 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814516 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814519 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814521 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814524 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814526 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814529 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814531 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814534 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 00:47:15.908966 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814536 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814541 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814544 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814547 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814550 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814552 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814555 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814557 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814560 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814562 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814566 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814570 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814573 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814575 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814578 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814581 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814584 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814587 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814589 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814592 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 00:47:15.909413 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814595 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814597 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814600 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814602 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814605 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814607 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814610 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814612 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814615 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814617 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814620 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814622 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814625 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814629 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814633 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814635 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814638 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814640 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814643 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814645 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 00:47:15.909911 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814648 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814650 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814653 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814656 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814660 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814662 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:15.814665 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.814670 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.814790 2570 server.go:962] "Client rotation is on, will bootstrap in background" May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.816948 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.817899 2570 server.go:1019] "Starting client certificate rotation" May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.817996 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.818032 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 00:47:15.910383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.850499 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.857904 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.880136 2570 log.go:25] "Validated CRI v1 runtime API" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.887764 2570 log.go:25] "Validated CRI v1 image API" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.889338 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.889655 2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.896947 2570 fs.go:135] Filesystem UUIDs: map[288c9ae6-66f6-4a10-b2fb-7cb3cc4cdbcf:/dev/nvme0n1p4 38080055-1a8b-4a68-9a80-843e2313fee2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 29 00:47:15.910690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.896962 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 00:47:15.910881 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.901817 2570 manager.go:217] Machine: {Timestamp:2026-05-29 00:47:15.901316695 +0000 UTC m=+0.512388019 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2500006 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f27779b9fb630262861e712beeafa SystemUUID:ec2f2777-9b9f-b630-2628-61e712beeafa BootID:bbc51049-fa0b-4fea-b516-031afadae80c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:a2:d6:61:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:a2:d6:61:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:90:e8:b3:56:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 00:47:15.910881 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.903228 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 00:47:15.910881 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.903301 2570 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 00:47:15.912030 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.912000 2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 00:47:15.912154 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.912033 2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 00:47:15.912199 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.912163 2570 topology_manager.go:138] "Creating topology manager with none policy" May 29 00:47:15.912199 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.912170 2570 container_manager_linux.go:306] "Creating device plugin manager" May 29 00:47:15.912199 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.912178 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 00:47:15.913383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.913373 2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 00:47:15.916244 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.916233 2570 state_mem.go:36] "Initialized new in-memory state store" May 29 00:47:15.916344 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.916335 2570 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 00:47:15.920497 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.920486 2570 kubelet.go:491] "Attempting to sync node with API server" May 29 00:47:15.920530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.920504 2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 00:47:15.920530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.920519 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 00:47:15.920530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.920529 2570 kubelet.go:397] "Adding apiserver pod source" May 29 00:47:15.920614 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.920537 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 00:47:15.922075 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.922064 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 00:47:15.922122 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.922083 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 00:47:15.929902 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.929886 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvkct" May 29 00:47:15.931560 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.931541 2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 00:47:15.933479 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.933466 2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 00:47:15.934393 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934382 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934398 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934404 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934409 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934417 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934423 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934428 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934434 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934441 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 00:47:15.934446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934446 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 00:47:15.934678 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934454 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 00:47:15.934750 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.934741 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 00:47:15.935002 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:15.934980 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 00:47:15.935065 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:15.935004 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 00:47:15.935709 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.935699 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 00:47:15.935738 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.935710 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 00:47:15.936874 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.936859 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvkct" May 29 00:47:15.939426 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.939412 2570 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 00:47:15.939488 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.939452 2570 server.go:1295] "Started kubelet" May 29 00:47:15.939576 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.939536 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 00:47:15.939720 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.939528 2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 00:47:15.939822 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.939730 2570 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 00:47:15.940197 ip-10-0-140-228 systemd[1]: Started Kubernetes Kubelet. May 29 00:47:15.941455 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.941439 2570 server.go:317] "Adding debug handlers to kubelet server" May 29 00:47:15.942001 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.941983 2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 00:47:15.947744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947727 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 00:47:15.947836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947743 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 00:47:15.947836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947822 2570 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 00:47:15.947836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947831 2570 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 00:47:15.947997 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947846 2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 00:47:15.947997 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947990 2570 reconstruct.go:97] "Volume reconstruction finished" May 29 00:47:15.948091 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.947999 2570 reconciler.go:26] "Reconciler: start to sync state" May 29 00:47:15.948676 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.948661 2570 factory.go:55] Registering systemd factory May 29 00:47:15.948731 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.948713 2570 factory.go:223] Registration of the systemd container factory successfully May 29 00:47:15.948976 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:15.948843 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:15.949042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.948892 2570 factory.go:153] Registering CRI-O factory May 29 00:47:15.949042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.948995 2570 factory.go:223] Registration of the crio container factory successfully May 29 00:47:15.949125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.949090 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 00:47:15.949125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.949108 2570 factory.go:103] Registering Raw factory May 29 00:47:15.949230 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.949126 2570 manager.go:1196] Started watching for new ooms in manager May 29 00:47:15.949558 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.949546 2570 manager.go:319] Starting recovery of all containers May 29 00:47:15.952441 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.952416 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:15.952868 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.952849 2570 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-228.ec2.internal" not found May 29 00:47:15.957025 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:15.956998 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-228.ec2.internal\" not found" node="ip-10-0-140-228.ec2.internal" May 29 00:47:15.957663 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:15.957641 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 00:47:15.965623 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.965609 2570 manager.go:324] Recovery completed May 29 00:47:15.966942 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.966840 2570 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-228.ec2.internal" not found May 29 00:47:15.969704 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.969692 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:15.971452 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.971435 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:15.971520 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.971467 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:15.971520 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.971482 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:15.972012 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.971998 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 00:47:15.972081 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.972012 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 00:47:15.972081 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.972031 2570 state_mem.go:36] "Initialized new in-memory state store" May 29 00:47:15.975209 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.975196 2570 policy_none.go:49] "None policy: Start" May 29 00:47:15.975275 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.975214 2570 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 00:47:15.975275 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:15.975227 2570 state_mem.go:35] "Initializing new in-memory state store" May 29 00:47:16.007378 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007362 2570 manager.go:341] "Starting Device Plugin manager" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.007399 2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007411 2570 server.go:85] "Starting device plugin registration server" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007609 2570 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007623 2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007679 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007760 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.007766 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.008206 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.008237 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.023621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.023107 2570 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-228.ec2.internal" not found May 29 00:47:16.083788 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.083760 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 00:47:16.084917 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.084901 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 00:47:16.084981 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.084934 2570 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 00:47:16.084981 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.084954 2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 00:47:16.084981 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.084967 2570 kubelet.go:2451] "Starting kubelet main sync loop" May 29 00:47:16.085126 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.085009 2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 00:47:16.087502 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.087486 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:16.107719 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.107692 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:16.110133 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.110119 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:16.110220 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.110149 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:16.110220 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.110163 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:16.110220 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.110190 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-228.ec2.internal" May 29 00:47:16.119041 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.119024 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-228.ec2.internal" May 29 00:47:16.119102 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.119042 2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-228.ec2.internal\": node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.134970 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.134955 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.185322 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.185283 2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal"] May 29 00:47:16.185377 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.185362 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:16.186033 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.186012 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:16.186104 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.186038 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:16.186104 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.186052 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:16.187629 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.187615 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:16.187808 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.187793 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.187870 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.187828 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:16.188230 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188214 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:16.188306 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188242 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:16.188306 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188252 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:16.188306 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188215 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:16.188397 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188344 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:16.188397 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.188367 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:16.189665 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.189650 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:16.189740 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.189673 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 00:47:16.190251 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.190230 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientMemory" May 29 00:47:16.190251 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.190254 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasNoDiskPressure" May 29 00:47:16.190364 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.190263 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeHasSufficientPID" May 29 00:47:16.214394 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.214374 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-228.ec2.internal\" not found" node="ip-10-0-140-228.ec2.internal" May 29 00:47:16.218835 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.218820 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-228.ec2.internal\" not found" node="ip-10-0-140-228.ec2.internal" May 29 00:47:16.235726 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.235708 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.249238 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.249217 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.249325 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.249248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.249325 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.249273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42adcfd06db77ec5a9455fbdef7bdeb1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-228.ec2.internal\" (UID: \"42adcfd06db77ec5a9455fbdef7bdeb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:16.336049 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.336016 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.350366 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350344 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.350450 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350387 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.350450 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350415 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.350450 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350441 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42adcfd06db77ec5a9455fbdef7bdeb1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-228.ec2.internal\" (UID: \"42adcfd06db77ec5a9455fbdef7bdeb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:16.350570 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350456 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4983b77e984965c049efac5ac4f35e90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal\" (UID: \"4983b77e984965c049efac5ac4f35e90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.350570 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.350468 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42adcfd06db77ec5a9455fbdef7bdeb1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-228.ec2.internal\" (UID: \"42adcfd06db77ec5a9455fbdef7bdeb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:16.436718 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.436667 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.517129 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.517104 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:16.521848 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.521832 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:16.537657 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.537625 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.638076 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.638053 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.738557 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.738500 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.817949 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.817927 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 00:47:16.818109 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.818089 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 00:47:16.818173 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.818121 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 00:47:16.839098 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.839074 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.938993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.938957 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 00:42:15 +0000 UTC" deadline="2028-01-12 15:41:07.13989486 +0000 UTC" May 29 00:47:16.938993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.938987 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14246h53m50.200911731s" May 29 00:47:16.940070 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:16.940049 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:16.948232 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.948216 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 00:47:16.970352 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.970325 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 00:47:16.989337 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.989289 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jwj5r" May 29 00:47:16.994494 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:16.994474 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jwj5r" May 29 00:47:17.041034 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.041014 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:17.125608 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:17.125582 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4983b77e984965c049efac5ac4f35e90.slice/crio-fd5da3945c2a93e5b0be347d978628bef10490204c4a3ea5174668fc9004a130 WatchSource:0}: Error finding container fd5da3945c2a93e5b0be347d978628bef10490204c4a3ea5174668fc9004a130: Status 404 returned error can't find the container with id fd5da3945c2a93e5b0be347d978628bef10490204c4a3ea5174668fc9004a130 May 29 00:47:17.125840 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:17.125823 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42adcfd06db77ec5a9455fbdef7bdeb1.slice/crio-97ee41ef78df5ecfaccce2966965b3f89c8fdb58ddb230b8085d656fc7ab6359 WatchSource:0}: Error finding container 97ee41ef78df5ecfaccce2966965b3f89c8fdb58ddb230b8085d656fc7ab6359: Status 404 returned error can't find the container with id 97ee41ef78df5ecfaccce2966965b3f89c8fdb58ddb230b8085d656fc7ab6359 May 29 00:47:17.132138 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.131484 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:47:17.142090 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.142067 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:17.242669 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.242611 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:17.342884 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.342857 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:17.347386 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.347370 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:17.443843 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.443819 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-228.ec2.internal\" not found" May 29 00:47:17.447345 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.447328 2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:17.448306 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.448292 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" May 29 00:47:17.460797 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.460767 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 00:47:17.461720 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.461709 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" May 29 00:47:17.469195 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.469178 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 00:47:17.650079 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.650017 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:17.922048 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.921981 2570 apiserver.go:52] "Watching apiserver" May 29 00:47:17.929855 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.929833 2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 00:47:17.931035 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.931000 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cswp2","openshift-dns/node-resolver-q87vg","openshift-image-registry/node-ca-k2z5p","openshift-multus/multus-additional-cni-plugins-89m5t","openshift-multus/multus-wp2th","openshift-ovn-kubernetes/ovnkube-node-hn2k9","kube-system/konnectivity-agent-v7x8c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal","openshift-multus/network-metrics-daemon-tq5gk","openshift-network-diagnostics/network-check-target-8x4sg","openshift-network-operator/iptables-alerter-mhz89"] May 29 00:47:17.933816 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.933336 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.934763 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.934742 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.936022 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.935854 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 00:47:17.936022 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.935888 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 00:47:17.936022 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.935897 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 00:47:17.936470 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.936314 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8cks6\"" May 29 00:47:17.936470 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.936323 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 00:47:17.937147 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.936963 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 00:47:17.937364 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.937292 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 00:47:17.937832 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.937625 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q87vg" May 29 00:47:17.938276 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.938255 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 00:47:17.938359 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.938276 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qzgb\"" May 29 00:47:17.938416 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.938398 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 00:47:17.939253 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.939232 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:17.940476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.940236 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 00:47:17.940476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.940322 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 00:47:17.940476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.940368 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9jltw\"" May 29 00:47:17.941180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.941159 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 00:47:17.942050 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.941510 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gq85h\"" May 29 00:47:17.942050 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.941731 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 00:47:17.942050 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.941744 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wp2th" May 29 00:47:17.942050 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.941968 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 00:47:17.944242 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.944224 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 00:47:17.944337 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.944253 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fhdtw\"" May 29 00:47:17.945575 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.944900 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.945575 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.945029 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 00:47:17.945575 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.945534 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 00:47:17.946066 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.945974 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 00:47:17.947479 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.947418 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 00:47:17.947667 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.947651 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-whpjh\"" May 29 00:47:17.948004 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.947985 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 00:47:17.948303 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.948279 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:17.949999 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.949985 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.950225 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.950060 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:17.950320 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.950296 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:17.950581 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.950565 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 00:47:17.950767 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.950729 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 00:47:17.950937 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.950921 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mxctp\"" May 29 00:47:17.951606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.951589 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:17.951686 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:17.951651 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:17.952562 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.952545 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 00:47:17.952642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.952547 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nsgw6\"" May 29 00:47:17.952891 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.952874 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 00:47:17.953321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.953292 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:17.953321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.953309 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 00:47:17.955468 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.955451 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 00:47:17.955558 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.955513 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 00:47:17.955705 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.955687 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 00:47:17.955768 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.955687 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4mft7\"" May 29 00:47:17.960214 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-ovn\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.960336 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47acc28e-f210-4e99-a744-1c441f730948-ovn-node-metrics-cert\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.960336 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-agent-certs\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:17.960457 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.960457 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqg8\" (UniqueName: \"kubernetes.io/projected/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kube-api-access-jxqg8\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.960457 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-cnibin\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.960457 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-bin\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.960457 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960441 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-conf-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a161583-291f-4f20-be45-659b586dab15-serviceca\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-os-release\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-socket-dir-parent\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960594 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-bin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-etc-kubernetes\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.960708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960712 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-k8s-cni-cncf-io\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960748 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-kubelet\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960812 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-lib-modules\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-host\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-etc-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960897 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-script-lib\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-registration-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-sys\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.960982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-etc-tuned\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.961042 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961038 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-slash\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961101 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-node-log\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-multus-daemon-config\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961150 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-systemd-units\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-netns\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961196 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-var-lib-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961221 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-system-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-socket-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-tmp\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-kubelet\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961332 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-config\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-device-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961409 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvd4w\" (UniqueName: \"kubernetes.io/projected/1460833c-45a2-493b-ae51-f0f10751ef71-kube-api-access-pvd4w\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-log-socket\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.961541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7kx\" (UniqueName: \"kubernetes.io/projected/73658a65-0421-461d-8fd2-6216b59395f0-kube-api-access-hq7kx\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961518 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-os-release\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pn49\" (UniqueName: \"kubernetes.io/projected/48d9c284-18f3-4bda-adbf-99205f2f2e47-kube-api-access-6pn49\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961569 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw6z7\" (UniqueName: \"kubernetes.io/projected/47acc28e-f210-4e99-a744-1c441f730948-kube-api-access-bw6z7\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-cnibin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-netns\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961664 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-modprobe-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-var-lib-kubelet\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961725 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961753 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-systemd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-env-overrides\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961816 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a161583-291f-4f20-be45-659b586dab15-host\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-konnectivity-ca\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961941 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-kubernetes\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962237 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.961975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73658a65-0421-461d-8fd2-6216b59395f0-tmp-dir\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962049 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-netd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962073 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/1a161583-291f-4f20-be45-659b586dab15-kube-api-access-2cv7w\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-hostroot\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962117 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-sys-fs\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-system-cni-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73658a65-0421-461d-8fd2-6216b59395f0-hosts-file\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962186 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-cni-binary-copy\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-multus\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pprrr\" (UniqueName: \"kubernetes.io/projected/663fa4f7-bded-42a1-b632-98cacf08650c-kube-api-access-pprrr\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962257 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-conf\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-multus-certs\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysconfig\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-systemd\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962352 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-run\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:17.962918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.962389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-binary-copy\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:17.995544 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.995512 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 00:42:16 +0000 UTC" deadline="2028-02-03 16:07:25.976742738 +0000 UTC" May 29 00:47:17.995544 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:17.995542 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14775h20m7.981204492s" May 29 00:47:18.049359 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.049334 2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 00:47:18.062605 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062576 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.062717 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062615 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-netd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.062717 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062646 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/1a161583-291f-4f20-be45-659b586dab15-kube-api-access-2cv7w\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.062717 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062671 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-hostroot\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062717 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.062717 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062698 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-sys-fs\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062722 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-system-cni-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062747 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73658a65-0421-461d-8fd2-6216b59395f0-hosts-file\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062765 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-sys-fs\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062790 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-netd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062770 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-cni-binary-copy\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062832 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-system-cni-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062838 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-hostroot\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062848 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-multus\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062869 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73658a65-0421-461d-8fd2-6216b59395f0-hosts-file\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062888 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-multus\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062889 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pprrr\" (UniqueName: \"kubernetes.io/projected/663fa4f7-bded-42a1-b632-98cacf08650c-kube-api-access-pprrr\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062918 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-conf\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-iptables-alerter-script\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.062986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.062977 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-multus-certs\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063002 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysconfig\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063033 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-systemd\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063041 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-multus-certs\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063056 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-run\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063092 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-binary-copy\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063105 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-systemd\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063111 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-run\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063110 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-conf\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063101 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysconfig\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063201 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-ovn\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063246 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47acc28e-f210-4e99-a744-1c441f730948-ovn-node-metrics-cert\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063272 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-agent-certs\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063277 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-ovn\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063377 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063410 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqg8\" (UniqueName: \"kubernetes.io/projected/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kube-api-access-jxqg8\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.063603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063413 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-cni-binary-copy\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063435 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-cnibin\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063488 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-cnibin\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063515 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-bin\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063541 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-conf-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063556 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063584 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-conf-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063592 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-cni-bin\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063632 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-binary-copy\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063651 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a161583-291f-4f20-be45-659b586dab15-serviceca\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063677 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-os-release\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063729 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-socket-dir-parent\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063753 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-bin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063790 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-etc-kubernetes\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063815 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.064321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063832 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-cni-bin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063842 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-os-release\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063837 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-k8s-cni-cncf-io\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063833 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-socket-dir-parent\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063863 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-multus-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063876 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-k8s-cni-cncf-io\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063881 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-kubelet\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064036 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-lib-modules\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064061 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-host\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064086 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-host-slash\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064110 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-etc-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063893 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-etc-kubernetes\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064131 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-script-lib\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064060 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a161583-291f-4f20-be45-659b586dab15-serviceca\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064163 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-lib-modules\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064191 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-etc-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064202 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-registration-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064223 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-sys\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.065143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064240 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-host\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064245 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-etc-tuned\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063917 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-var-lib-kubelet\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064266 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064289 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064295 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-registration-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064311 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-slash\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064331 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-node-log\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064361 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-multus-daemon-config\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064380 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-systemd-units\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064402 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-netns\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064431 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-var-lib-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064457 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-system-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064482 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-socket-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064505 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-tmp\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064560 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-kubelet\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064579 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-sys\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-config\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-systemd-units\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064639 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-system-cni-dir\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064654 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-script-lib\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064660 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-run-netns\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.063956 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-sysctl-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.064884 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-device-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065326 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065375 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-slash\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065454 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-socket-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065535 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-kubelet\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-node-log\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065593 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvd4w\" (UniqueName: \"kubernetes.io/projected/1460833c-45a2-493b-ae51-f0f10751ef71-kube-api-access-pvd4w\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065623 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-device-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsfql\" (UniqueName: \"kubernetes.io/projected/88562b5d-f14a-4abe-9560-e83a77fbcbfa-kube-api-access-hsfql\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065668 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-var-lib-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/663fa4f7-bded-42a1-b632-98cacf08650c-multus-daemon-config\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.066828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065670 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-log-socket\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065704 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-log-socket\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065837 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065879 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7kx\" (UniqueName: \"kubernetes.io/projected/73658a65-0421-461d-8fd2-6216b59395f0-kube-api-access-hq7kx\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065908 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-openvswitch\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065936 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-ovnkube-config\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065937 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d9c284-18f3-4bda-adbf-99205f2f2e47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.065959 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-os-release\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066057 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pn49\" (UniqueName: \"kubernetes.io/projected/48d9c284-18f3-4bda-adbf-99205f2f2e47-kube-api-access-6pn49\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066082 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-os-release\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066099 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066199 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw6z7\" (UniqueName: \"kubernetes.io/projected/47acc28e-f210-4e99-a744-1c441f730948-kube-api-access-bw6z7\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066210 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066251 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-cnibin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066358 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-netns\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066393 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-cnibin\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066438 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-modprobe-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.067625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066474 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-var-lib-kubelet\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066513 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-modprobe-d\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066530 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/663fa4f7-bded-42a1-b632-98cacf08650c-host-run-netns\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066594 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-var-lib-kubelet\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066606 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066645 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-systemd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47acc28e-f210-4e99-a744-1c441f730948-run-systemd\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066686 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-env-overrides\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066716 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d9c284-18f3-4bda-adbf-99205f2f2e47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066737 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a161583-291f-4f20-be45-659b586dab15-host\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066762 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-konnectivity-ca\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066847 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a161583-291f-4f20-be45-659b586dab15-host\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.066915 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067030 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47acc28e-f210-4e99-a744-1c441f730948-ovn-node-metrics-cert\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067090 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-kubernetes\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067117 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73658a65-0421-461d-8fd2-6216b59395f0-tmp-dir\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwhzb\" (UniqueName: \"kubernetes.io/projected/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-kube-api-access-vwhzb\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.068392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067223 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067271 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1460833c-45a2-493b-ae51-f0f10751ef71-etc-kubernetes\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067391 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-konnectivity-ca\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067465 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73658a65-0421-461d-8fd2-6216b59395f0-tmp-dir\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067807 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47acc28e-f210-4e99-a744-1c441f730948-env-overrides\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.067957 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-etc-tuned\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.068434 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629-agent-certs\") pod \"konnectivity-agent-v7x8c\" (UID: \"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629\") " pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:18.069134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.068528 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1460833c-45a2-493b-ae51-f0f10751ef71-tmp\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.070755 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.070530 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pprrr\" (UniqueName: \"kubernetes.io/projected/663fa4f7-bded-42a1-b632-98cacf08650c-kube-api-access-pprrr\") pod \"multus-wp2th\" (UID: \"663fa4f7-bded-42a1-b632-98cacf08650c\") " pod="openshift-multus/multus-wp2th" May 29 00:47:18.071171 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.071150 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/1a161583-291f-4f20-be45-659b586dab15-kube-api-access-2cv7w\") pod \"node-ca-k2z5p\" (UID: \"1a161583-291f-4f20-be45-659b586dab15\") " pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.074646 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.074618 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqg8\" (UniqueName: \"kubernetes.io/projected/6690d7b2-7e99-402e-9f9d-f090ae9bd9a0-kube-api-access-jxqg8\") pod \"aws-ebs-csi-driver-node-jvc8k\" (UID: \"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.076052 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.076018 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvd4w\" (UniqueName: \"kubernetes.io/projected/1460833c-45a2-493b-ae51-f0f10751ef71-kube-api-access-pvd4w\") pod \"tuned-cswp2\" (UID: \"1460833c-45a2-493b-ae51-f0f10751ef71\") " pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.076143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.076117 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7kx\" (UniqueName: \"kubernetes.io/projected/73658a65-0421-461d-8fd2-6216b59395f0-kube-api-access-hq7kx\") pod \"node-resolver-q87vg\" (UID: \"73658a65-0421-461d-8fd2-6216b59395f0\") " pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.076357 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.076336 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pn49\" (UniqueName: \"kubernetes.io/projected/48d9c284-18f3-4bda-adbf-99205f2f2e47-kube-api-access-6pn49\") pod \"multus-additional-cni-plugins-89m5t\" (UID: \"48d9c284-18f3-4bda-adbf-99205f2f2e47\") " pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.076866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.076842 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw6z7\" (UniqueName: \"kubernetes.io/projected/47acc28e-f210-4e99-a744-1c441f730948-kube-api-access-bw6z7\") pod \"ovnkube-node-hn2k9\" (UID: \"47acc28e-f210-4e99-a744-1c441f730948\") " pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.089621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.089580 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" event={"ID":"4983b77e984965c049efac5ac4f35e90","Type":"ContainerStarted","Data":"fd5da3945c2a93e5b0be347d978628bef10490204c4a3ea5174668fc9004a130"} May 29 00:47:18.090660 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.090638 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" event={"ID":"42adcfd06db77ec5a9455fbdef7bdeb1","Type":"ContainerStarted","Data":"97ee41ef78df5ecfaccce2966965b3f89c8fdb58ddb230b8085d656fc7ab6359"} May 29 00:47:18.168195 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168173 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsfql\" (UniqueName: \"kubernetes.io/projected/88562b5d-f14a-4abe-9560-e83a77fbcbfa-kube-api-access-hsfql\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.168300 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168214 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwhzb\" (UniqueName: \"kubernetes.io/projected/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-kube-api-access-vwhzb\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.168368 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168335 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-iptables-alerter-script\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.168421 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168389 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.168476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168422 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:18.168476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168458 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-host-slash\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.168574 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168521 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-host-slash\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.168574 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.168523 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:18.168667 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.168609 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:18.668582458 +0000 UTC m=+3.279653771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:18.168931 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.168914 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-iptables-alerter-script\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.174268 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.174221 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:18.174268 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.174240 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:18.174268 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.174251 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:18.174446 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.174308 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:18.674291806 +0000 UTC m=+3.285363131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:18.176657 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.176638 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwhzb\" (UniqueName: \"kubernetes.io/projected/8cb7cae9-55b5-4fa5-be4f-cf238848bac1-kube-api-access-vwhzb\") pod \"iptables-alerter-mhz89\" (UID: \"8cb7cae9-55b5-4fa5-be4f-cf238848bac1\") " pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.176760 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.176741 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsfql\" (UniqueName: \"kubernetes.io/projected/88562b5d-f14a-4abe-9560-e83a77fbcbfa-kube-api-access-hsfql\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.248958 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.248934 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:18.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.255718 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cswp2" May 29 00:47:18.264538 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.264520 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q87vg" May 29 00:47:18.272204 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.272187 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2z5p" May 29 00:47:18.281851 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.281834 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wp2th" May 29 00:47:18.295437 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.295415 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89m5t" May 29 00:47:18.301936 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.301918 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:18.310412 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.310393 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" May 29 00:47:18.316912 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.316894 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mhz89" May 29 00:47:18.361447 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.361429 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 00:47:18.671606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.671574 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:18.671796 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.671715 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:18.671858 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.671796 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:19.671760697 +0000 UTC m=+4.282832030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:18.772940 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.772910 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:18.773106 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.773032 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:18.773106 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.773051 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:18.773106 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.773062 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:18.773258 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.773114 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:19.773095301 +0000 UTC m=+4.384166613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:18.843112 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.842950 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663fa4f7_bded_42a1_b632_98cacf08650c.slice/crio-e9170767c4fa30203c46599583a4bfef70c04f0bd60e0f7a7d2fa2e379e9d18a WatchSource:0}: Error finding container e9170767c4fa30203c46599583a4bfef70c04f0bd60e0f7a7d2fa2e379e9d18a: Status 404 returned error can't find the container with id e9170767c4fa30203c46599583a4bfef70c04f0bd60e0f7a7d2fa2e379e9d18a May 29 00:47:18.844219 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.844162 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6690d7b2_7e99_402e_9f9d_f090ae9bd9a0.slice/crio-6bd8e538441100951cfa8f15e21af24cb00a0614f80e770835c1877a59832247 WatchSource:0}: Error finding container 6bd8e538441100951cfa8f15e21af24cb00a0614f80e770835c1877a59832247: Status 404 returned error can't find the container with id 6bd8e538441100951cfa8f15e21af24cb00a0614f80e770835c1877a59832247 May 29 00:47:18.845649 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.845445 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb7cae9_55b5_4fa5_be4f_cf238848bac1.slice/crio-ac000ed4be4e990ee85fbc4276cb892617531dfd64317c88e2d1a78acef5dcb9 WatchSource:0}: Error finding container ac000ed4be4e990ee85fbc4276cb892617531dfd64317c88e2d1a78acef5dcb9: Status 404 returned error can't find the container with id ac000ed4be4e990ee85fbc4276cb892617531dfd64317c88e2d1a78acef5dcb9 May 29 00:47:18.850477 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.850454 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47acc28e_f210_4e99_a744_1c441f730948.slice/crio-767a4c9c08b56ed7a8204b06d51244f37a83674b1ba4fd506c8ce96a72d32071 WatchSource:0}: Error finding container 767a4c9c08b56ed7a8204b06d51244f37a83674b1ba4fd506c8ce96a72d32071: Status 404 returned error can't find the container with id 767a4c9c08b56ed7a8204b06d51244f37a83674b1ba4fd506c8ce96a72d32071 May 29 00:47:18.851379 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.851357 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d9c284_18f3_4bda_adbf_99205f2f2e47.slice/crio-79afaa5f969b1e3602d064b47e54cd6317f2d0036aa75957a8c10deef6282d38 WatchSource:0}: Error finding container 79afaa5f969b1e3602d064b47e54cd6317f2d0036aa75957a8c10deef6282d38: Status 404 returned error can't find the container with id 79afaa5f969b1e3602d064b47e54cd6317f2d0036aa75957a8c10deef6282d38 May 29 00:47:18.852161 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.852140 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a161583_291f_4f20_be45_659b586dab15.slice/crio-fdb0b9b29ed0d29c67ab3bee106a167086c79a616741351d9c4b07155130ebf7 WatchSource:0}: Error finding container fdb0b9b29ed0d29c67ab3bee106a167086c79a616741351d9c4b07155130ebf7: Status 404 returned error can't find the container with id fdb0b9b29ed0d29c67ab3bee106a167086c79a616741351d9c4b07155130ebf7 May 29 00:47:18.853068 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.852919 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7f5ec0_ec83_4cf7_9ba9_70dd476f7629.slice/crio-098a0885c06586015929e235c6b5ee42c595f57a1d51cbeba587d537d40363a8 WatchSource:0}: Error finding container 098a0885c06586015929e235c6b5ee42c595f57a1d51cbeba587d537d40363a8: Status 404 returned error can't find the container with id 098a0885c06586015929e235c6b5ee42c595f57a1d51cbeba587d537d40363a8 May 29 00:47:18.857877 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:47:18.854564 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73658a65_0421_461d_8fd2_6216b59395f0.slice/crio-bf6b50c3f06903b4fabb7090086c333202d6910ad14ae6582bdaaad8f05d6bd5 WatchSource:0}: Error finding container bf6b50c3f06903b4fabb7090086c333202d6910ad14ae6582bdaaad8f05d6bd5: Status 404 returned error can't find the container with id bf6b50c3f06903b4fabb7090086c333202d6910ad14ae6582bdaaad8f05d6bd5 May 29 00:47:18.918309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.918285 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7grvp"] May 29 00:47:18.920082 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.920067 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:18.920139 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:18.920123 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:18.974305 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.974284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-kubelet-config\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:18.974611 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.974322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:18.974611 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.974378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-dbus\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:18.996352 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.996319 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 00:42:16 +0000 UTC" deadline="2028-03-14 07:14:34.699091688 +0000 UTC" May 29 00:47:18.996352 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:18.996351 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15726h27m15.702743561s" May 29 00:47:19.074678 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.074656 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-kubelet-config\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.074793 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.074686 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.074793 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.074705 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-dbus\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.074917 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.074797 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-kubelet-config\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.074917 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.074819 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:19.074917 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.074848 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31cb6727-e341-4652-97b7-56a6e9ef26ae-dbus\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.074917 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.074873 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:19.574860073 +0000 UTC m=+4.185931384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:19.085455 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.085394 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:19.085455 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.085413 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:19.085596 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.085498 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:19.085813 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.085767 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:19.093062 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.093041 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" event={"ID":"42adcfd06db77ec5a9455fbdef7bdeb1","Type":"ContainerStarted","Data":"bbf77ea2641788a4ae09872f4856bdceb5e09a6d5cc4d1e8ff86f04a06b2d068"} May 29 00:47:19.094141 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.094121 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cswp2" event={"ID":"1460833c-45a2-493b-ae51-f0f10751ef71","Type":"ContainerStarted","Data":"59d5c4f011e69deb23d3a9a4949c31005dcc80b8e6fad4f39f498df3fc702a75"} May 29 00:47:19.095008 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.094990 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q87vg" event={"ID":"73658a65-0421-461d-8fd2-6216b59395f0","Type":"ContainerStarted","Data":"bf6b50c3f06903b4fabb7090086c333202d6910ad14ae6582bdaaad8f05d6bd5"} May 29 00:47:19.097169 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.097149 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2z5p" event={"ID":"1a161583-291f-4f20-be45-659b586dab15","Type":"ContainerStarted","Data":"fdb0b9b29ed0d29c67ab3bee106a167086c79a616741351d9c4b07155130ebf7"} May 29 00:47:19.098354 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.098330 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"767a4c9c08b56ed7a8204b06d51244f37a83674b1ba4fd506c8ce96a72d32071"} May 29 00:47:19.099609 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.099579 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mhz89" event={"ID":"8cb7cae9-55b5-4fa5-be4f-cf238848bac1","Type":"ContainerStarted","Data":"ac000ed4be4e990ee85fbc4276cb892617531dfd64317c88e2d1a78acef5dcb9"} May 29 00:47:19.100614 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.100596 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v7x8c" event={"ID":"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629","Type":"ContainerStarted","Data":"098a0885c06586015929e235c6b5ee42c595f57a1d51cbeba587d537d40363a8"} May 29 00:47:19.101728 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.101709 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerStarted","Data":"79afaa5f969b1e3602d064b47e54cd6317f2d0036aa75957a8c10deef6282d38"} May 29 00:47:19.102651 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.102621 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" event={"ID":"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0","Type":"ContainerStarted","Data":"6bd8e538441100951cfa8f15e21af24cb00a0614f80e770835c1877a59832247"} May 29 00:47:19.103576 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.103555 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wp2th" event={"ID":"663fa4f7-bded-42a1-b632-98cacf08650c","Type":"ContainerStarted","Data":"e9170767c4fa30203c46599583a4bfef70c04f0bd60e0f7a7d2fa2e379e9d18a"} May 29 00:47:19.110125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.110091 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-228.ec2.internal" podStartSLOduration=2.110079873 podStartE2EDuration="2.110079873s" podCreationTimestamp="2026-05-29 00:47:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:47:19.109968505 +0000 UTC m=+3.721039838" watchObservedRunningTime="2026-05-29 00:47:19.110079873 +0000 UTC m=+3.721151207" May 29 00:47:19.388325 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.388281 2570 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7676697c9070d510ae2a4f434303284c8c01de3bffd7998b564c53315ff50af2" May 29 00:47:19.388598 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.388533 2570 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-driver,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7676697c9070d510ae2a4f434303284c8c01de3bffd7998b564c53315ff50af2,Command:[],Args:[node --endpoint=$(CSI_ENDPOINT) --logtostderr --v=2 --reserved-volume-attachments=1],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:healthz,HostPort:10300,ContainerPort:10300,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:CSI_ENDPOINT,Value:unix:/csi/csi.sock,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:device-dir,ReadOnly:false,MountPath:/dev,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:etc-selinux,ReadOnly:false,MountPath:/etc/selinux,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys-fs,ReadOnly:false,MountPath:/sys/fs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jxqg8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{1 0 healthz},Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:3,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod aws-ebs-csi-driver-node-jvc8k_openshift-cluster-csi-drivers(6690d7b2-7e99-402e-9f9d-f090ae9bd9a0): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" May 29 00:47:19.579739 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.579665 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:19.579910 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.579804 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:19.579910 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.579858 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:20.579840925 +0000 UTC m=+5.190912238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:19.680028 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.679994 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:19.680193 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.680163 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:19.680248 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.680219 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:21.680201467 +0000 UTC m=+6.291272778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:19.781161 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:19.781122 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:19.781316 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.781304 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:19.781379 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.781325 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:19.781379 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.781337 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:19.781463 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:19.781397 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:21.781378504 +0000 UTC m=+6.392449830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:20.088342 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:20.087828 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:20.088342 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:20.087953 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:20.115742 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:20.115711 2570 generic.go:358] "Generic (PLEG): container finished" podID="4983b77e984965c049efac5ac4f35e90" containerID="1333fe4707756609565fd78bc7df5418d44336d2ae497d194c40091c9a7a44ce" exitCode=0 May 29 00:47:20.116069 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:20.115983 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" event={"ID":"4983b77e984965c049efac5ac4f35e90","Type":"ContainerDied","Data":"1333fe4707756609565fd78bc7df5418d44336d2ae497d194c40091c9a7a44ce"} May 29 00:47:20.589304 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:20.589271 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:20.589472 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:20.589436 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:20.589524 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:20.589495 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:22.58947749 +0000 UTC m=+7.200548807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:21.086730 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.086097 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:21.086730 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.086216 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:21.086730 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.086305 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:21.086730 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.086393 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:21.122843 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.122674 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" event={"ID":"4983b77e984965c049efac5ac4f35e90","Type":"ContainerStarted","Data":"ac12cb5f30dbfb8079cbeae0dee2f8bf2cc1574bf453470f9b2c199bf8b2d08b"} May 29 00:47:21.138205 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.138160 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-228.ec2.internal" podStartSLOduration=4.138142819 podStartE2EDuration="4.138142819s" podCreationTimestamp="2026-05-29 00:47:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:47:21.137016868 +0000 UTC m=+5.748088204" watchObservedRunningTime="2026-05-29 00:47:21.138142819 +0000 UTC m=+5.749214155" May 29 00:47:21.697639 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.697074 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:21.697639 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.697234 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:21.697639 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.697295 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:25.697275242 +0000 UTC m=+10.308346567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:21.798539 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:21.798472 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:21.798715 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.798677 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:21.798715 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.798696 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:21.798910 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.798707 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:21.798910 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:21.798830 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:25.798810897 +0000 UTC m=+10.409882210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:22.086528 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:22.086492 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:22.086706 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:22.086619 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:22.606045 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:22.605644 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:22.606045 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:22.605835 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:22.606045 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:22.605892 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:26.605874343 +0000 UTC m=+11.216945659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:23.086245 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:23.086117 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:23.086245 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:23.086167 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:23.086477 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:23.086257 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:23.086619 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:23.086579 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:24.086014 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:24.085982 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:24.086461 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:24.086118 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:25.085539 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:25.085511 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:25.085715 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.085610 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:25.085715 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:25.085637 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:25.085838 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.085717 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:25.730052 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:25.729970 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:25.730480 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.730104 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:25.730480 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.730182 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:33.730161351 +0000 UTC m=+18.341232666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:25.831153 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:25.831117 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:25.831317 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.831277 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:25.831317 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.831294 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:25.831317 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.831303 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:25.831470 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:25.831359 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:33.831340992 +0000 UTC m=+18.442412308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:26.086217 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:26.086144 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:26.086358 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:26.086234 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:26.636752 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:26.636706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:26.636943 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:26.636872 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:26.636943 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:26.636937 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:34.636918015 +0000 UTC m=+19.247989326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:27.085466 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:27.085432 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:27.085913 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:27.085557 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:27.085913 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:27.085437 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:27.086035 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:27.085987 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:28.086676 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.086398 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:28.087268 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:28.086732 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:28.133695 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.133664 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cswp2" event={"ID":"1460833c-45a2-493b-ae51-f0f10751ef71","Type":"ContainerStarted","Data":"e15de871f3d329c504a45a2a93d486afd661084ad7e8df4ed51f874f88c2573e"} May 29 00:47:28.135548 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.135522 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q87vg" event={"ID":"73658a65-0421-461d-8fd2-6216b59395f0","Type":"ContainerStarted","Data":"a10525b335788301d8f8f791be9edb62f6d53f9228a4d1231e62f210db53a288"} May 29 00:47:28.137244 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.137221 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2z5p" event={"ID":"1a161583-291f-4f20-be45-659b586dab15","Type":"ContainerStarted","Data":"cec94dbdadf50af1865e989f34a4a57a90338c3adbca7ca7ba77d69ae2c58054"} May 29 00:47:28.138729 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.138656 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v7x8c" event={"ID":"8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629","Type":"ContainerStarted","Data":"7b1a0d08be83bf319ddab5825669987e8ca254d40aa0c032cfa030c215766b2a"} May 29 00:47:28.140100 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.140002 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="58324f958f655dc960e6b102cc1a44ffbe7cec0e3beed762d47cfeeaa8a3fc52" exitCode=0 May 29 00:47:28.140100 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.140069 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"58324f958f655dc960e6b102cc1a44ffbe7cec0e3beed762d47cfeeaa8a3fc52"} May 29 00:47:28.141346 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.141314 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" event={"ID":"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0","Type":"ContainerStarted","Data":"3687625d65df2f57da2b8b4f9d46a4fb40222f95b856af110f07cea0ac4c01d0"} May 29 00:47:28.151357 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.151319 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cswp2" podStartSLOduration=3.239324876 podStartE2EDuration="12.151309385s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.858903342 +0000 UTC m=+3.469974661" lastFinishedPulling="2026-05-29 00:47:27.770887845 +0000 UTC m=+12.381959170" observedRunningTime="2026-05-29 00:47:28.151110818 +0000 UTC m=+12.762182149" watchObservedRunningTime="2026-05-29 00:47:28.151309385 +0000 UTC m=+12.762380717" May 29 00:47:28.164905 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.164867 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-q87vg" podStartSLOduration=3.277359916 podStartE2EDuration="12.164857499s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.856943979 +0000 UTC m=+3.468015291" lastFinishedPulling="2026-05-29 00:47:27.744441552 +0000 UTC m=+12.355512874" observedRunningTime="2026-05-29 00:47:28.164379714 +0000 UTC m=+12.775451049" watchObservedRunningTime="2026-05-29 00:47:28.164857499 +0000 UTC m=+12.775928832" May 29 00:47:28.209399 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.209363 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k2z5p" podStartSLOduration=3.323674552 podStartE2EDuration="12.209354057s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.855190134 +0000 UTC m=+3.466261445" lastFinishedPulling="2026-05-29 00:47:27.740869637 +0000 UTC m=+12.351940950" observedRunningTime="2026-05-29 00:47:28.192026338 +0000 UTC m=+12.803097671" watchObservedRunningTime="2026-05-29 00:47:28.209354057 +0000 UTC m=+12.820425389" May 29 00:47:28.209685 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:28.209661 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v7x8c" podStartSLOduration=3.32220329 podStartE2EDuration="12.209654844s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.859070368 +0000 UTC m=+3.470141679" lastFinishedPulling="2026-05-29 00:47:27.746521921 +0000 UTC m=+12.357593233" observedRunningTime="2026-05-29 00:47:28.209110389 +0000 UTC m=+12.820181723" watchObservedRunningTime="2026-05-29 00:47:28.209654844 +0000 UTC m=+12.820726177" May 29 00:47:29.085317 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:29.085227 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:29.085466 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:29.085234 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:29.085466 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:29.085370 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:29.085466 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:29.085421 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:29.689768 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:29.689704 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:29.690591 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:29.690413 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:30.086377 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:30.085901 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:30.086377 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:30.086031 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:30.147428 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:30.147386 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mhz89" event={"ID":"8cb7cae9-55b5-4fa5-be4f-cf238848bac1","Type":"ContainerStarted","Data":"1bda280afd9ce44048b3e65f3d045f0ac2954a8d9dcc457ad37ab8902d05449f"} May 29 00:47:30.162075 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:30.162023 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mhz89" podStartSLOduration=5.250930039 podStartE2EDuration="14.1620064s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.848277818 +0000 UTC m=+3.459349143" lastFinishedPulling="2026-05-29 00:47:27.759354178 +0000 UTC m=+12.370425504" observedRunningTime="2026-05-29 00:47:30.16116625 +0000 UTC m=+14.772237583" watchObservedRunningTime="2026-05-29 00:47:30.1620064 +0000 UTC m=+14.773077712" May 29 00:47:31.085376 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:31.085332 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:31.086055 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:31.085633 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:31.086055 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:31.085735 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:31.086055 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:31.085865 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:31.148660 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:31.148623 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 00:47:32.086037 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:32.086005 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:32.086480 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:32.086141 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:33.085452 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:33.085260 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:33.085663 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:33.085271 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:33.085663 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.085548 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:33.085663 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.085641 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:33.793883 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:33.793842 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:33.794297 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.793974 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:33.794297 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.794054 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:47:49.794034275 +0000 UTC m=+34.405105586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:33.894167 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:33.894136 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:33.894316 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.894285 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:33.894316 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.894304 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:33.894316 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.894312 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:33.894434 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:33.894363 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:49.894345767 +0000 UTC m=+34.505417078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:34.085901 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:34.085830 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:34.086041 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:34.085944 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:34.699080 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:34.699049 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:34.699242 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:34.699203 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:34.699293 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:34.699276 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:47:50.69925521 +0000 UTC m=+35.310326536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:35.085661 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:35.085629 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:35.085661 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:35.085643 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:35.086215 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:35.085742 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:35.086215 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:35.085849 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:36.008867 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:36.008833 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:36.009033 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:36.008977 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 00:47:36.009759 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:36.009730 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v7x8c" May 29 00:47:36.086248 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:36.086219 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:36.086619 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:36.086321 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:37.085952 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:37.085924 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:37.086151 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:37.085932 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:37.086151 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:37.086007 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:37.086151 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:37.086097 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:38.085220 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:38.085194 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:38.085706 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:38.085306 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:39.085761 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:39.085743 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:39.085761 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:39.085753 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:39.086126 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:39.085856 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:39.086126 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:39.085967 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:39.290583 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:39.290542 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" podUID="6690d7b2-7e99-402e-9f9d-f090ae9bd9a0" May 29 00:47:40.086308 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.086130 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:40.086863 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:40.086400 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:40.164081 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.164044 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" event={"ID":"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0","Type":"ContainerStarted","Data":"8f79b0b75705f1914140208884139b544baae98c924301c1f8b60d0cc9a36688"} May 29 00:47:40.165625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.165482 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wp2th" event={"ID":"663fa4f7-bded-42a1-b632-98cacf08650c","Type":"ContainerStarted","Data":"f180ff3b055dfe505732040182d988f9aff1f3cf312392506ff56a3a8ec35d42"} May 29 00:47:40.167956 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.167939 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:47:40.168301 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168283 2570 generic.go:358] "Generic (PLEG): container finished" podID="47acc28e-f210-4e99-a744-1c441f730948" containerID="a2f77dbab426da38b0f943c2c9c62309ccb52c109ac311690272ecacf0ea5125" exitCode=1 May 29 00:47:40.168382 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168342 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"aa766cf8d2bc92935e791dbffc0e846910a18683d700a23925aa346ae0c2abb6"} May 29 00:47:40.168382 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168367 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"5b5004933525e77cb1a93a9e74ff6738c460aecbcaae12cd8d4e1af4f25a517d"} May 29 00:47:40.168382 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168378 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"bdac4adb905587f05c7a27118857d7b13a42fc6df7027b0a218930ceee2edc1d"} May 29 00:47:40.168526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168389 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"ce87522578094fb9a4f5e83cdf714541c9b439446e8333137cf72cf992de20e6"} May 29 00:47:40.168526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168399 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerDied","Data":"a2f77dbab426da38b0f943c2c9c62309ccb52c109ac311690272ecacf0ea5125"} May 29 00:47:40.168526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.168413 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"9998c56db711d6300f034f8bc09d769abcaa41157f2954fbf136920fbdb20ec9"} May 29 00:47:40.170078 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.169945 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="03162cb065324b21c796bc290fed384fd8142d8749195ab9178f7434e85ca191" exitCode=0 May 29 00:47:40.170078 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.169978 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"03162cb065324b21c796bc290fed384fd8142d8749195ab9178f7434e85ca191"} May 29 00:47:40.196980 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.196942 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-wp2th" podStartSLOduration=3.920809105 podStartE2EDuration="24.196931039s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.844647233 +0000 UTC m=+3.455718544" lastFinishedPulling="2026-05-29 00:47:39.120769167 +0000 UTC m=+23.731840478" observedRunningTime="2026-05-29 00:47:40.196552483 +0000 UTC m=+24.807623817" watchObservedRunningTime="2026-05-29 00:47:40.196931039 +0000 UTC m=+24.808002371" May 29 00:47:40.273938 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.273916 2570 patch_prober.go:28] interesting pod/aws-ebs-csi-driver-node-jvc8k container/csi-node-driver-registrar namespace/openshift-cluster-csi-drivers: Liveness probe status=failure output="Get \"http://127.0.0.1:10309/healthz\": dial tcp 127.0.0.1:10309: connect: connection refused" start-of-body= May 29 00:47:40.274013 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:40.273959 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" podUID="6690d7b2-7e99-402e-9f9d-f090ae9bd9a0" containerName="csi-node-driver-registrar" probeResult="failure" output="Get \"http://127.0.0.1:10309/healthz\": dial tcp 127.0.0.1:10309: connect: connection refused" May 29 00:47:41.085846 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:41.085818 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:41.085981 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:41.085873 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:41.085981 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:41.085964 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:41.086165 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:41.086140 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:42.085444 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:42.085419 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:42.085898 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:42.085547 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:42.176615 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:42.176596 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:47:42.177018 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:42.176997 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"19bf6901c1fd0e24f4c7e405539386a187b9501774a9666800bdcd59d1f51a12"} May 29 00:47:42.178682 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:42.178659 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="33001509c35252690025a8fb60e8dd69f3bc843cd046bb34f23500ed0d317557" exitCode=0 May 29 00:47:42.178763 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:42.178697 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"33001509c35252690025a8fb60e8dd69f3bc843cd046bb34f23500ed0d317557"} May 29 00:47:43.085723 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.085701 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:43.086126 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.085701 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:43.086126 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:43.085822 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:43.086126 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:43.085916 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:43.105088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.105066 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 00:47:43.182030 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.181982 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="1dd4a2d055430c2d335601324bc8259e0b63c79f40cab758386940498819c3b6" exitCode=0 May 29 00:47:43.182115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.182046 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"1dd4a2d055430c2d335601324bc8259e0b63c79f40cab758386940498819c3b6"} May 29 00:47:43.183989 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.183966 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" event={"ID":"6690d7b2-7e99-402e-9f9d-f090ae9bd9a0","Type":"ContainerStarted","Data":"7150b56d3748a5b9d467eff2e4a54e19bd94d7c34feb4913493fbf5b36cd2d08"} May 29 00:47:43.220255 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:43.220222 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvc8k" podStartSLOduration=3.991049966 podStartE2EDuration="27.220213042s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.847448763 +0000 UTC m=+3.458520076" lastFinishedPulling="2026-05-29 00:47:42.07661184 +0000 UTC m=+26.687683152" observedRunningTime="2026-05-29 00:47:43.219718994 +0000 UTC m=+27.830790327" watchObservedRunningTime="2026-05-29 00:47:43.220213042 +0000 UTC m=+27.831284413" May 29 00:47:44.023709 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:44.023592 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T00:47:43.105083023Z","UUID":"876fbe00-6ef5-4722-84d8-80ff623b0c0d","Handler":null,"Name":"","Endpoint":""} May 29 00:47:44.025002 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:44.024981 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 00:47:44.025123 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:44.025017 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 00:47:44.085325 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:44.085301 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:44.085452 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:44.085406 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:45.086370 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.086169 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:45.086855 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.086170 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:45.086855 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:45.086454 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:45.086855 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:45.086555 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:45.190420 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.190397 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:47:45.190724 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.190699 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"61db27283cf95d6647cae56b0242918dcad58c11027a863467c5bda4a3883ba4"} May 29 00:47:45.191073 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.191055 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:45.191147 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.191081 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:45.191238 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.191220 2570 scope.go:117] "RemoveContainer" containerID="a2f77dbab426da38b0f943c2c9c62309ccb52c109ac311690272ecacf0ea5125" May 29 00:47:45.210733 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:45.210685 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:46.086414 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.086383 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:46.086883 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:46.086508 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:46.139293 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.139251 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7grvp"] May 29 00:47:46.142090 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.142063 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tq5gk"] May 29 00:47:46.142219 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.142186 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:46.142307 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:46.142281 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:46.142700 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.142678 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8x4sg"] May 29 00:47:46.142808 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.142788 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:46.142901 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:46.142878 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:46.196754 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.196733 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:47:46.197133 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.197100 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" event={"ID":"47acc28e-f210-4e99-a744-1c441f730948","Type":"ContainerStarted","Data":"111ba61203d09d9c08fa525c63b213612cb65e98ff20b4c4c1d34051f0048b01"} May 29 00:47:46.197133 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.197124 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:46.197283 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:46.197210 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:46.197594 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.197571 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:46.216301 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.216278 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:47:46.228707 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:46.228672 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" podStartSLOduration=9.937507033 podStartE2EDuration="30.228660668s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.852585618 +0000 UTC m=+3.463656945" lastFinishedPulling="2026-05-29 00:47:39.143739268 +0000 UTC m=+23.754810580" observedRunningTime="2026-05-29 00:47:46.227073623 +0000 UTC m=+30.838144957" watchObservedRunningTime="2026-05-29 00:47:46.228660668 +0000 UTC m=+30.839732001" May 29 00:47:48.085677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:48.085481 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:48.086124 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:48.085482 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:48.086124 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:48.085762 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:48.086124 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:48.085868 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:48.086124 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:48.085565 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:48.086124 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:48.085941 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:49.815265 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:49.815231 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:49.815811 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.815393 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:49.815811 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.815464 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:48:21.815444576 +0000 UTC m=+66.426515891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 00:47:49.916452 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:49.916427 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:49.916598 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.916537 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 00:47:49.916598 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.916550 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 00:47:49.916598 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.916559 2570 projected.go:194] Error preparing data for projected volume kube-api-access-gmx6v for pod openshift-network-diagnostics/network-check-target-8x4sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:49.916693 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:49.916602 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v podName:4e1383d8-59b0-41da-88e5-d989e520d9e7 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:21.916589307 +0000 UTC m=+66.527660617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmx6v" (UniqueName: "kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v") pod "network-check-target-8x4sg" (UID: "4e1383d8-59b0-41da-88e5-d989e520d9e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 00:47:50.085347 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:50.085283 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:50.085347 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:50.085316 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:50.085347 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:50.085322 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:50.085573 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:50.085389 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:50.085573 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:50.085467 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:50.085573 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:50.085522 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:50.723028 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:50.723004 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:50.723128 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:50.723101 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 00:47:50.723166 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:50.723152 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret podName:31cb6727-e341-4652-97b7-56a6e9ef26ae nodeName:}" failed. No retries permitted until 2026-05-29 00:48:22.723135848 +0000 UTC m=+67.334207160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret") pod "global-pull-secret-syncer-7grvp" (UID: "31cb6727-e341-4652-97b7-56a6e9ef26ae") : object "kube-system"/"original-pull-secret" not registered May 29 00:47:51.208572 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:51.208540 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="4f3d21d713f613f30f41df7823bb2ab1524f05779fd9a169b892832b261ef4b3" exitCode=0 May 29 00:47:51.209162 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:51.208609 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"4f3d21d713f613f30f41df7823bb2ab1524f05779fd9a169b892832b261ef4b3"} May 29 00:47:52.085585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.085551 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:52.085756 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.085561 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:52.085756 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.085669 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq5gk" podUID="88562b5d-f14a-4abe-9560-e83a77fbcbfa" May 29 00:47:52.085756 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.085750 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7grvp" podUID="31cb6727-e341-4652-97b7-56a6e9ef26ae" May 29 00:47:52.086031 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.085561 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:52.086031 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.085846 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8x4sg" podUID="4e1383d8-59b0-41da-88e5-d989e520d9e7" May 29 00:47:52.213007 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.212974 2570 generic.go:358] "Generic (PLEG): container finished" podID="48d9c284-18f3-4bda-adbf-99205f2f2e47" containerID="653214e365ec76c41f3e557bc00aaea6c2322d225298f502666c395784074923" exitCode=0 May 29 00:47:52.213007 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.213009 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerDied","Data":"653214e365ec76c41f3e557bc00aaea6c2322d225298f502666c395784074923"} May 29 00:47:52.637143 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.637087 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-228.ec2.internal" event="NodeReady" May 29 00:47:52.637225 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.637188 2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 00:47:52.681044 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.681019 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-24zsk"] May 29 00:47:52.683076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.683061 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.684253 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.684230 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dwlss"] May 29 00:47:52.685337 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.685318 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 00:47:52.685558 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.685534 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7vx5w\"" May 29 00:47:52.685635 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.685613 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 00:47:52.686414 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.686397 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:52.689056 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.689037 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 00:47:52.689235 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.689219 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 00:47:52.689343 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.689258 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nghjs\"" May 29 00:47:52.689343 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.689310 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 00:47:52.693934 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.693801 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24zsk"] May 29 00:47:52.696758 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.696741 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwlss"] May 29 00:47:52.836122 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:52.836215 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcsd\" (UniqueName: \"kubernetes.io/projected/1ece5a88-26a8-4a7a-8298-a19644ca0034-kube-api-access-jdcsd\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:52.836215 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836150 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-tmp-dir\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.836215 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.836315 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-config-volume\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.836315 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.836294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjltn\" (UniqueName: \"kubernetes.io/projected/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-kube-api-access-cjltn\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.937567 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937516 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-tmp-dir\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.937567 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937552 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.937673 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937590 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-config-volume\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.937673 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937641 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjltn\" (UniqueName: \"kubernetes.io/projected/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-kube-api-access-cjltn\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.937736 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937712 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:52.937736 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.937722 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:52.937835 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937742 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcsd\" (UniqueName: \"kubernetes.io/projected/1ece5a88-26a8-4a7a-8298-a19644ca0034-kube-api-access-jdcsd\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:52.937835 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.937794 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:47:53.437757127 +0000 UTC m=+38.048828438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:47:52.937835 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.937826 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:52.938011 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:52.937878 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:53.437861889 +0000 UTC m=+38.048933210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:47:52.938011 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.937874 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-tmp-dir\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.938367 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.938342 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-config-volume\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.947488 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.947463 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjltn\" (UniqueName: \"kubernetes.io/projected/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-kube-api-access-cjltn\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:52.947640 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:52.947619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcsd\" (UniqueName: \"kubernetes.io/projected/1ece5a88-26a8-4a7a-8298-a19644ca0034-kube-api-access-jdcsd\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:53.218602 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:53.218512 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89m5t" event={"ID":"48d9c284-18f3-4bda-adbf-99205f2f2e47","Type":"ContainerStarted","Data":"6b033d9a34f1edfce3d6366c08d7b413810a46582eb95dccbbb137ebd28a21b9"} May 29 00:47:53.240281 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:53.240232 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-89m5t" podStartSLOduration=5.754980055 podStartE2EDuration="37.240220082s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:47:18.853835605 +0000 UTC m=+3.464906922" lastFinishedPulling="2026-05-29 00:47:50.339075639 +0000 UTC m=+34.950146949" observedRunningTime="2026-05-29 00:47:53.238448939 +0000 UTC m=+37.849520271" watchObservedRunningTime="2026-05-29 00:47:53.240220082 +0000 UTC m=+37.851291480" May 29 00:47:53.440476 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:53.440450 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:53.440610 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:53.440504 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:53.440610 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:53.440575 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:53.440727 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:53.440630 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.440616248 +0000 UTC m=+39.051687559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:47:53.440727 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:53.440631 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:53.440727 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:53.440688 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:47:54.440671033 +0000 UTC m=+39.051742399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:47:54.085442 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.085411 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:47:54.085580 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.085413 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:47:54.085625 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.085412 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:47:54.087936 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.087899 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 00:47:54.089090 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.089062 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2thf\"" May 29 00:47:54.089205 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.089100 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 00:47:54.089205 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.089062 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlrhs\"" May 29 00:47:54.089205 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.089167 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 00:47:54.089359 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.089231 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 00:47:54.447189 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.447130 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:54.447522 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:54.447212 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:54.447522 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:54.447259 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:54.447522 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:54.447304 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:54.447522 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:54.447321 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:47:56.447300263 +0000 UTC m=+41.058371587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:47:54.447522 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:54.447338 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:47:56.447327987 +0000 UTC m=+41.058399313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:47:56.460432 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:56.460403 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:47:56.460801 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:47:56.460446 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:47:56.460801 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:56.460540 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:47:56.460801 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:56.460558 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:47:56.460801 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:56.460598 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:00.46058364 +0000 UTC m=+45.071654951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:47:56.460801 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:47:56.460613 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:48:00.460606663 +0000 UTC m=+45.071677974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:48:00.489744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:00.489695 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:48:00.490121 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:00.489769 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:48:00.490121 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:00.489840 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:00.490121 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:00.489931 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:08.489901717 +0000 UTC m=+53.100973028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:48:00.490121 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:00.489930 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:00.490121 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:00.489968 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:48:08.489960973 +0000 UTC m=+53.101032289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:48:08.542381 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:08.542348 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:48:08.542381 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:08.542392 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:48:08.542930 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:08.542513 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:08.542930 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:08.542574 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.542558146 +0000 UTC m=+69.153629457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:48:08.542930 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:08.542513 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:08.542930 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:08.542614 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:24.542605554 +0000 UTC m=+69.153676864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:48:18.150431 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.150398 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl"] May 29 00:48:18.154009 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.153984 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf"] May 29 00:48:18.154159 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.154138 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.156099 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.156078 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.156540 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.156517 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 00:48:18.156540 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.156532 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 00:48:18.156694 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.156544 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 00:48:18.156694 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.156603 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 29 00:48:18.158235 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.158182 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 29 00:48:18.158353 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.158252 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 29 00:48:18.158420 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.158375 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 29 00:48:18.158499 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.158486 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 29 00:48:18.160101 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.160075 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl"] May 29 00:48:18.166141 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.166118 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf"] May 29 00:48:18.205941 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.205918 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.206051 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.205945 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/93fbc315-543b-41cc-8541-aab12dbb9439-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.206051 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcm5q\" (UniqueName: \"kubernetes.io/projected/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-kube-api-access-kcm5q\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.206175 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.206175 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-tmp\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.206175 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.206175 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.206382 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.206382 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.206198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnkl\" (UniqueName: \"kubernetes.io/projected/93fbc315-543b-41cc-8541-aab12dbb9439-kube-api-access-6mnkl\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.211486 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.211467 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hn2k9" May 29 00:48:18.307300 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307277 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-tmp\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.307383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307304 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.307383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307322 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.307383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307336 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.307383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307352 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnkl\" (UniqueName: \"kubernetes.io/projected/93fbc315-543b-41cc-8541-aab12dbb9439-kube-api-access-6mnkl\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.307588 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307565 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.307707 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307685 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/93fbc315-543b-41cc-8541-aab12dbb9439-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.307827 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307692 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-tmp\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.307898 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307863 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm5q\" (UniqueName: \"kubernetes.io/projected/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-kube-api-access-kcm5q\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.307972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.307916 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.308429 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.308406 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/93fbc315-543b-41cc-8541-aab12dbb9439-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.310278 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.310249 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.310464 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.310445 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-ca\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.310567 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.310549 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.310701 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.310683 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.310752 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.310732 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93fbc315-543b-41cc-8541-aab12dbb9439-hub\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.316437 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.316418 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnkl\" (UniqueName: \"kubernetes.io/projected/93fbc315-543b-41cc-8541-aab12dbb9439-kube-api-access-6mnkl\") pod \"cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf\" (UID: \"93fbc315-543b-41cc-8541-aab12dbb9439\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.316666 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.316646 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcm5q\" (UniqueName: \"kubernetes.io/projected/aa4a562b-5afc-4b08-8522-feaf5a4ac0da-kube-api-access-kcm5q\") pod \"klusterlet-addon-workmgr-8ccc76f6-l9cpl\" (UID: \"aa4a562b-5afc-4b08-8522-feaf5a4ac0da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.464697 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.464642 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:18.485261 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.485239 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:48:18.616583 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.616555 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl"] May 29 00:48:18.619648 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:48:18.619622 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4a562b_5afc_4b08_8522_feaf5a4ac0da.slice/crio-7beef3e7884bbf03079d0109b54c8dfa8d3df6e791a981f497979824ab361958 WatchSource:0}: Error finding container 7beef3e7884bbf03079d0109b54c8dfa8d3df6e791a981f497979824ab361958: Status 404 returned error can't find the container with id 7beef3e7884bbf03079d0109b54c8dfa8d3df6e791a981f497979824ab361958 May 29 00:48:18.632732 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:18.632709 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf"] May 29 00:48:18.635724 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:48:18.635701 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93fbc315_543b_41cc_8541_aab12dbb9439.slice/crio-59ad409edde75c9db202f1c278b2e5721347de12ab87315963583e8c51e5e189 WatchSource:0}: Error finding container 59ad409edde75c9db202f1c278b2e5721347de12ab87315963583e8c51e5e189: Status 404 returned error can't find the container with id 59ad409edde75c9db202f1c278b2e5721347de12ab87315963583e8c51e5e189 May 29 00:48:19.266730 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:19.266692 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerStarted","Data":"59ad409edde75c9db202f1c278b2e5721347de12ab87315963583e8c51e5e189"} May 29 00:48:19.267666 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:19.267638 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" event={"ID":"aa4a562b-5afc-4b08-8522-feaf5a4ac0da","Type":"ContainerStarted","Data":"7beef3e7884bbf03079d0109b54c8dfa8d3df6e791a981f497979824ab361958"} May 29 00:48:21.835136 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.835092 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:48:21.837984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.837959 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 00:48:21.846189 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:21.846164 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 00:48:21.846278 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:21.846236 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs podName:88562b5d-f14a-4abe-9560-e83a77fbcbfa nodeName:}" failed. No retries permitted until 2026-05-29 00:49:25.846213887 +0000 UTC m=+130.457285211 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs") pod "network-metrics-daemon-tq5gk" (UID: "88562b5d-f14a-4abe-9560-e83a77fbcbfa") : secret "metrics-daemon-secret" not found May 29 00:48:21.936312 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.936282 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:48:21.939136 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.939114 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 00:48:21.949562 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.949541 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 00:48:21.959740 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:21.959719 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmx6v\" (UniqueName: \"kubernetes.io/projected/4e1383d8-59b0-41da-88e5-d989e520d9e7-kube-api-access-gmx6v\") pod \"network-check-target-8x4sg\" (UID: \"4e1383d8-59b0-41da-88e5-d989e520d9e7\") " pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:48:22.005724 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.005697 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2thf\"" May 29 00:48:22.013760 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.013741 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:48:22.741669 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.741631 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:48:22.744715 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.744687 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 00:48:22.754321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.754285 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31cb6727-e341-4652-97b7-56a6e9ef26ae-original-pull-secret\") pod \"global-pull-secret-syncer-7grvp\" (UID: \"31cb6727-e341-4652-97b7-56a6e9ef26ae\") " pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:48:22.896741 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:22.896706 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7grvp" May 29 00:48:24.240093 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.240060 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8x4sg"] May 29 00:48:24.242842 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:48:24.242810 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1383d8_59b0_41da_88e5_d989e520d9e7.slice/crio-fedc753487764ae58d78d2cd056f570969cec366306705f6aca137dda1e9c0a0 WatchSource:0}: Error finding container fedc753487764ae58d78d2cd056f570969cec366306705f6aca137dda1e9c0a0: Status 404 returned error can't find the container with id fedc753487764ae58d78d2cd056f570969cec366306705f6aca137dda1e9c0a0 May 29 00:48:24.253437 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.253402 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7grvp"] May 29 00:48:24.257686 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:48:24.257665 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cb6727_e341_4652_97b7_56a6e9ef26ae.slice/crio-850e4d739e2f1401dea91d788872d292aff76f8b48367d3b8e4da6d551c84a47 WatchSource:0}: Error finding container 850e4d739e2f1401dea91d788872d292aff76f8b48367d3b8e4da6d551c84a47: Status 404 returned error can't find the container with id 850e4d739e2f1401dea91d788872d292aff76f8b48367d3b8e4da6d551c84a47 May 29 00:48:24.279206 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.279140 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8x4sg" event={"ID":"4e1383d8-59b0-41da-88e5-d989e520d9e7","Type":"ContainerStarted","Data":"fedc753487764ae58d78d2cd056f570969cec366306705f6aca137dda1e9c0a0"} May 29 00:48:24.280999 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.280971 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" event={"ID":"aa4a562b-5afc-4b08-8522-feaf5a4ac0da","Type":"ContainerStarted","Data":"8dd5371c45dda58d9fbde7c8d251a9eec2e2b22c809093fe9d15c542b120748f"} May 29 00:48:24.282445 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.282400 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerStarted","Data":"aab86a05c00e911ca080ad4003932cfa5ab26f08cc5521a802c1162de66b35fe"} May 29 00:48:24.283595 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.283560 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7grvp" event={"ID":"31cb6727-e341-4652-97b7-56a6e9ef26ae","Type":"ContainerStarted","Data":"850e4d739e2f1401dea91d788872d292aff76f8b48367d3b8e4da6d551c84a47"} May 29 00:48:24.555186 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.555156 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:48:24.555354 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:24.555203 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:48:24.555354 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:24.555315 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:24.555354 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:24.555323 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:24.555479 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:24.555363 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:48:56.555350964 +0000 UTC m=+101.166422274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:48:24.555479 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:24.555387 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:48:56.555368017 +0000 UTC m=+101.166439329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:48:25.287053 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:25.287025 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:25.288624 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:25.288588 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" May 29 00:48:25.303843 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:25.303225 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccc76f6-l9cpl" podStartSLOduration=1.787937983 podStartE2EDuration="7.303205959s" podCreationTimestamp="2026-05-29 00:48:18 +0000 UTC" firstStartedPulling="2026-05-29 00:48:18.622799739 +0000 UTC m=+63.233871050" lastFinishedPulling="2026-05-29 00:48:24.138067711 +0000 UTC m=+68.749139026" observedRunningTime="2026-05-29 00:48:25.301801379 +0000 UTC m=+69.912872710" watchObservedRunningTime="2026-05-29 00:48:25.303205959 +0000 UTC m=+69.914277297" May 29 00:48:29.298060 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.298025 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8x4sg" event={"ID":"4e1383d8-59b0-41da-88e5-d989e520d9e7","Type":"ContainerStarted","Data":"8c91e132f3432594339b3422c148e876fa6709cc182c1914b37f74ba544226a4"} May 29 00:48:29.298479 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.298143 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:48:29.299977 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.299955 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerStarted","Data":"dafb99bddb5f4829525851ac3adf7b8690e9b7d5d5a33f78c15fb16119682757"} May 29 00:48:29.300097 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.299981 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerStarted","Data":"51381061ffcb6a562afa728332c84e5444b88f245f0800fcd8f5c26bfdabc183"} May 29 00:48:29.301326 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.301299 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7grvp" event={"ID":"31cb6727-e341-4652-97b7-56a6e9ef26ae","Type":"ContainerStarted","Data":"f154e8b57b3db9cb24de7ff08f4180b6a84bdbab195ed794e3e76fc09cea5070"} May 29 00:48:29.313000 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.312939 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8x4sg" podStartSLOduration=68.425119106 podStartE2EDuration="1m13.312924635s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:48:24.244838438 +0000 UTC m=+68.855909752" lastFinishedPulling="2026-05-29 00:48:29.132643966 +0000 UTC m=+73.743715281" observedRunningTime="2026-05-29 00:48:29.311269098 +0000 UTC m=+73.922340431" watchObservedRunningTime="2026-05-29 00:48:29.312924635 +0000 UTC m=+73.923995968" May 29 00:48:29.327043 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.327004 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" podStartSLOduration=0.841209724 podStartE2EDuration="11.326991157s" podCreationTimestamp="2026-05-29 00:48:18 +0000 UTC" firstStartedPulling="2026-05-29 00:48:18.637307305 +0000 UTC m=+63.248378625" lastFinishedPulling="2026-05-29 00:48:29.123088746 +0000 UTC m=+73.734160058" observedRunningTime="2026-05-29 00:48:29.326561758 +0000 UTC m=+73.937633091" watchObservedRunningTime="2026-05-29 00:48:29.326991157 +0000 UTC m=+73.938062492" May 29 00:48:29.339651 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:29.339608 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7grvp" podStartSLOduration=66.462827977 podStartE2EDuration="1m11.339600127s" podCreationTimestamp="2026-05-29 00:47:18 +0000 UTC" firstStartedPulling="2026-05-29 00:48:24.25909097 +0000 UTC m=+68.870162284" lastFinishedPulling="2026-05-29 00:48:29.135863123 +0000 UTC m=+73.746934434" observedRunningTime="2026-05-29 00:48:29.338798759 +0000 UTC m=+73.949870089" watchObservedRunningTime="2026-05-29 00:48:29.339600127 +0000 UTC m=+73.950671460" May 29 00:48:55.571642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:55.571524 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q87vg_73658a65-0421-461d-8fd2-6216b59395f0/dns-node-resolver/0.log" May 29 00:48:56.371712 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:56.371682 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2z5p_1a161583-291f-4f20-be45-659b586dab15/node-ca/0.log" May 29 00:48:56.579963 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:56.579933 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:48:56.580301 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:48:56.579991 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:48:56.580301 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:56.580090 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 00:48:56.580301 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:56.580171 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert podName:1ece5a88-26a8-4a7a-8298-a19644ca0034 nodeName:}" failed. No retries permitted until 2026-05-29 00:50:00.580155672 +0000 UTC m=+165.191226983 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert") pod "ingress-canary-dwlss" (UID: "1ece5a88-26a8-4a7a-8298-a19644ca0034") : secret "canary-serving-cert" not found May 29 00:48:56.580301 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:56.580090 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 00:48:56.580301 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:48:56.580243 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls podName:f769af73-0a5d-4f6b-b238-d864ffc6f0ce nodeName:}" failed. No retries permitted until 2026-05-29 00:50:00.580229363 +0000 UTC m=+165.191300686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls") pod "dns-default-24zsk" (UID: "f769af73-0a5d-4f6b-b238-d864ffc6f0ce") : secret "dns-default-metrics-tls" not found May 29 00:49:00.306292 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:00.306251 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8x4sg" May 29 00:49:22.521985 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.521952 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxtgb"] May 29 00:49:22.524181 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.524159 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.526658 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.526636 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 00:49:22.527797 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.527758 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 00:49:22.527928 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.527809 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 00:49:22.528116 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.528099 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 00:49:22.528221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.528123 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4g569\"" May 29 00:49:22.535259 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.535235 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxtgb"] May 29 00:49:22.617948 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.617925 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fff7f4b85-srh7j"] May 29 00:49:22.619905 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.619890 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.622397 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.622356 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnqb5\"" May 29 00:49:22.622506 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.622409 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 00:49:22.622506 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.622354 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 00:49:22.622506 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.622485 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 00:49:22.628389 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.628369 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 00:49:22.631804 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.631769 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fff7f4b85-srh7j"] May 29 00:49:22.647180 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.647155 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b60d5d-8fc2-4c92-8946-91d1f87554ec-data-volume\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.647269 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.647187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b60d5d-8fc2-4c92-8946-91d1f87554ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.647269 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.647218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87t8j\" (UniqueName: \"kubernetes.io/projected/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-api-access-87t8j\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.647341 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.647330 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.647378 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.647358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b60d5d-8fc2-4c92-8946-91d1f87554ec-crio-socket\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748283 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-bound-sa-token\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748369 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-ca-trust-extracted\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748369 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748312 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-installation-pull-secrets\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748369 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748356 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748478 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748390 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-certificates\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748478 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-tls\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748478 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748455 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b60d5d-8fc2-4c92-8946-91d1f87554ec-data-volume\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748478 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748472 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b60d5d-8fc2-4c92-8946-91d1f87554ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748492 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87t8j\" (UniqueName: \"kubernetes.io/projected/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-api-access-87t8j\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-trusted-ca\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdww2\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-kube-api-access-kdww2\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748620 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b60d5d-8fc2-4c92-8946-91d1f87554ec-crio-socket\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748842 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748667 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-image-registry-private-configuration\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.748842 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748677 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b60d5d-8fc2-4c92-8946-91d1f87554ec-crio-socket\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748842 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748815 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b60d5d-8fc2-4c92-8946-91d1f87554ec-data-volume\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.748989 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.748849 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.750729 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.750707 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b60d5d-8fc2-4c92-8946-91d1f87554ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.756333 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.756313 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87t8j\" (UniqueName: \"kubernetes.io/projected/10b60d5d-8fc2-4c92-8946-91d1f87554ec-kube-api-access-87t8j\") pod \"insights-runtime-extractor-bxtgb\" (UID: \"10b60d5d-8fc2-4c92-8946-91d1f87554ec\") " pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.833196 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.833127 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxtgb" May 29 00:49:22.849506 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849487 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-ca-trust-extracted\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849514 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-installation-pull-secrets\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849543 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-certificates\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849574 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-tls\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849727 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849607 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-trusted-ca\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849727 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849648 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdww2\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-kube-api-access-kdww2\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849727 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849697 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-image-registry-private-configuration\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849906 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849741 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-bound-sa-token\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.849960 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.849920 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-ca-trust-extracted\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.850691 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.850665 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-certificates\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.850820 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.850701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-trusted-ca\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.852069 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.852043 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-registry-tls\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.852276 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.852255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-image-registry-private-configuration\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.852416 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.852397 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-installation-pull-secrets\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.857751 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.857725 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-bound-sa-token\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.858058 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.858033 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdww2\" (UniqueName: \"kubernetes.io/projected/da7fde44-11fe-4d62-af91-9e1a90ed1bbd-kube-api-access-kdww2\") pod \"image-registry-5fff7f4b85-srh7j\" (UID: \"da7fde44-11fe-4d62-af91-9e1a90ed1bbd\") " pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.927984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.927960 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:22.954060 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:22.954033 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxtgb"] May 29 00:49:22.956879 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:49:22.956855 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b60d5d_8fc2_4c92_8946_91d1f87554ec.slice/crio-41a064e456436c6063bf04a440d588a355e634def004f3aabbf71851a5f425b6 WatchSource:0}: Error finding container 41a064e456436c6063bf04a440d588a355e634def004f3aabbf71851a5f425b6: Status 404 returned error can't find the container with id 41a064e456436c6063bf04a440d588a355e634def004f3aabbf71851a5f425b6 May 29 00:49:23.051726 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.051697 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fff7f4b85-srh7j"] May 29 00:49:23.054635 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:49:23.054613 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7fde44_11fe_4d62_af91_9e1a90ed1bbd.slice/crio-db1fa165be40dd01c5e3cba034faf28c446d2c3dfd025f480c9802f677747c3d WatchSource:0}: Error finding container db1fa165be40dd01c5e3cba034faf28c446d2c3dfd025f480c9802f677747c3d: Status 404 returned error can't find the container with id db1fa165be40dd01c5e3cba034faf28c446d2c3dfd025f480c9802f677747c3d May 29 00:49:23.441040 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.440950 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" event={"ID":"da7fde44-11fe-4d62-af91-9e1a90ed1bbd","Type":"ContainerStarted","Data":"150692e6019808dd91d0bc9ecfb21699e09d4d1e9222667bf0032c0c1677ca6a"} May 29 00:49:23.441040 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.440987 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" event={"ID":"da7fde44-11fe-4d62-af91-9e1a90ed1bbd","Type":"ContainerStarted","Data":"db1fa165be40dd01c5e3cba034faf28c446d2c3dfd025f480c9802f677747c3d"} May 29 00:49:23.441040 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.441028 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:49:23.442368 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.442340 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxtgb" event={"ID":"10b60d5d-8fc2-4c92-8946-91d1f87554ec","Type":"ContainerStarted","Data":"ff301d7b01274bff58781c13f92fbbcff3862ddbc9e2430e258101d9f84d7e9d"} May 29 00:49:23.442368 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.442370 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxtgb" event={"ID":"10b60d5d-8fc2-4c92-8946-91d1f87554ec","Type":"ContainerStarted","Data":"41a064e456436c6063bf04a440d588a355e634def004f3aabbf71851a5f425b6"} May 29 00:49:23.458533 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:23.458498 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podStartSLOduration=1.458486394 podStartE2EDuration="1.458486394s" podCreationTimestamp="2026-05-29 00:49:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:49:23.45836887 +0000 UTC m=+128.069440203" watchObservedRunningTime="2026-05-29 00:49:23.458486394 +0000 UTC m=+128.069557727" May 29 00:49:24.446339 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:24.446302 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxtgb" event={"ID":"10b60d5d-8fc2-4c92-8946-91d1f87554ec","Type":"ContainerStarted","Data":"022fc98e210d24e5f9b8c4ca522a9f2fd1b8b4a6c931aaddce817a5719430855"} May 29 00:49:25.452399 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.452360 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxtgb" event={"ID":"10b60d5d-8fc2-4c92-8946-91d1f87554ec","Type":"ContainerStarted","Data":"2fb1e7365a4a6dcbfe9cb7e42b17579253e09894e80a320ee27a08288a4b2452"} May 29 00:49:25.469319 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.469271 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxtgb" podStartSLOduration=1.267487198 podStartE2EDuration="3.469259405s" podCreationTimestamp="2026-05-29 00:49:22 +0000 UTC" firstStartedPulling="2026-05-29 00:49:23.028807609 +0000 UTC m=+127.639878919" lastFinishedPulling="2026-05-29 00:49:25.230579811 +0000 UTC m=+129.841651126" observedRunningTime="2026-05-29 00:49:25.46812407 +0000 UTC m=+130.079195403" watchObservedRunningTime="2026-05-29 00:49:25.469259405 +0000 UTC m=+130.080330737" May 29 00:49:25.876101 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.876066 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:49:25.878541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.878517 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88562b5d-f14a-4abe-9560-e83a77fbcbfa-metrics-certs\") pod \"network-metrics-daemon-tq5gk\" (UID: \"88562b5d-f14a-4abe-9560-e83a77fbcbfa\") " pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:49:25.910283 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.910255 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlrhs\"" May 29 00:49:25.918317 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:25.918295 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq5gk" May 29 00:49:26.037209 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:26.037181 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tq5gk"] May 29 00:49:26.039940 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:49:26.039913 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88562b5d_f14a_4abe_9560_e83a77fbcbfa.slice/crio-f6140dc227ea1be4d1f8ba98507e67b1ed79e412679518d28776d6901cc32c99 WatchSource:0}: Error finding container f6140dc227ea1be4d1f8ba98507e67b1ed79e412679518d28776d6901cc32c99: Status 404 returned error can't find the container with id f6140dc227ea1be4d1f8ba98507e67b1ed79e412679518d28776d6901cc32c99 May 29 00:49:26.455491 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:26.455462 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq5gk" event={"ID":"88562b5d-f14a-4abe-9560-e83a77fbcbfa","Type":"ContainerStarted","Data":"f6140dc227ea1be4d1f8ba98507e67b1ed79e412679518d28776d6901cc32c99"} May 29 00:49:27.459080 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:27.459043 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq5gk" event={"ID":"88562b5d-f14a-4abe-9560-e83a77fbcbfa","Type":"ContainerStarted","Data":"826b26d19d061d02b49964dc518d0c2703fdec95e9339b2ac3ce4f8818473afe"} May 29 00:49:27.459442 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:27.459086 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq5gk" event={"ID":"88562b5d-f14a-4abe-9560-e83a77fbcbfa","Type":"ContainerStarted","Data":"f6134fa2b9976d0e6c3cbc04c6bb3d395ca924e6df04d6646276b006680b6691"} May 29 00:49:27.474963 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:27.474923 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tq5gk" podStartSLOduration=130.2340611 podStartE2EDuration="2m11.474910757s" podCreationTimestamp="2026-05-29 00:47:16 +0000 UTC" firstStartedPulling="2026-05-29 00:49:26.04144658 +0000 UTC m=+130.652517891" lastFinishedPulling="2026-05-29 00:49:27.282296233 +0000 UTC m=+131.893367548" observedRunningTime="2026-05-29 00:49:27.473420331 +0000 UTC m=+132.084491654" watchObservedRunningTime="2026-05-29 00:49:27.474910757 +0000 UTC m=+132.085982118" May 29 00:49:34.495978 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.495945 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h764g"] May 29 00:49:34.498254 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.498238 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.501286 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.501261 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 00:49:34.501400 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.501337 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ss4hn\"" May 29 00:49:34.501400 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.501394 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 00:49:34.502360 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.502341 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 00:49:34.502591 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.502577 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 00:49:34.502650 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.502634 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 00:49:34.502688 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.502638 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 00:49:34.635883 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.635858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.635984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.635886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-root\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.635984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.635914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.635984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.635939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-accelerators-collector-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.636115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.636001 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-sys\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.636115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.636025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-wtmp\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.636115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.636054 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-textfile\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.636115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.636072 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2f4\" (UniqueName: \"kubernetes.io/projected/c8b15d23-a77c-498c-ac8f-7cfe1868267d-kube-api-access-nd2f4\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.636261 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.636117 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-metrics-client-ca\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737028 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.736995 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-wtmp\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737040 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-textfile\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737064 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2f4\" (UniqueName: \"kubernetes.io/projected/c8b15d23-a77c-498c-ac8f-7cfe1868267d-kube-api-access-nd2f4\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737106 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-metrics-client-ca\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737160 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737185 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-wtmp\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737192 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-root\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737236 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737262 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-accelerators-collector-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737296 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-sys\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-root\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737349 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b15d23-a77c-498c-ac8f-7cfe1868267d-sys\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:49:34.737401 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:49:34.737462 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls podName:c8b15d23-a77c-498c-ac8f-7cfe1868267d nodeName:}" failed. No retries permitted until 2026-05-29 00:49:35.237443008 +0000 UTC m=+139.848514323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls") pod "node-exporter-h764g" (UID: "c8b15d23-a77c-498c-ac8f-7cfe1868267d") : secret "node-exporter-tls" not found May 29 00:49:34.737500 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737480 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-textfile\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737825 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737804 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-metrics-client-ca\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.737874 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.737845 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-accelerators-collector-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.739365 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.739348 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:34.745238 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:34.745217 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2f4\" (UniqueName: \"kubernetes.io/projected/c8b15d23-a77c-498c-ac8f-7cfe1868267d-kube-api-access-nd2f4\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:35.240990 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:35.240961 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:35.243005 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:35.242986 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8b15d23-a77c-498c-ac8f-7cfe1868267d-node-exporter-tls\") pod \"node-exporter-h764g\" (UID: \"c8b15d23-a77c-498c-ac8f-7cfe1868267d\") " pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:35.406904 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:35.406883 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h764g" May 29 00:49:35.482924 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:35.482894 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h764g" event={"ID":"c8b15d23-a77c-498c-ac8f-7cfe1868267d","Type":"ContainerStarted","Data":"3333e15c020cb4effcac52fdcb923cecced3ba0a97b6ce1622146a619784d88c"} May 29 00:49:36.486241 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:36.486214 2570 generic.go:358] "Generic (PLEG): container finished" podID="c8b15d23-a77c-498c-ac8f-7cfe1868267d" containerID="1a87e3c5ce53764ed102def1ceef431459a2cf4c5db8ed5486fb144eaedb372d" exitCode=0 May 29 00:49:36.486530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:36.486271 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h764g" event={"ID":"c8b15d23-a77c-498c-ac8f-7cfe1868267d","Type":"ContainerDied","Data":"1a87e3c5ce53764ed102def1ceef431459a2cf4c5db8ed5486fb144eaedb372d"} May 29 00:49:37.490491 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:37.490450 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h764g" event={"ID":"c8b15d23-a77c-498c-ac8f-7cfe1868267d","Type":"ContainerStarted","Data":"cdbd79c0296eae623024a737bcf52e83a85e848dce56e6f55ef04d4644381cb3"} May 29 00:49:37.490491 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:37.490492 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h764g" event={"ID":"c8b15d23-a77c-498c-ac8f-7cfe1868267d","Type":"ContainerStarted","Data":"96e66078a3510826b42dfaca9175069faa75f2abf9d7b4cd891bc71851f3ecfe"} May 29 00:49:37.508797 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:37.508732 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h764g" podStartSLOduration=2.626714116 podStartE2EDuration="3.508716362s" podCreationTimestamp="2026-05-29 00:49:34 +0000 UTC" firstStartedPulling="2026-05-29 00:49:35.421518881 +0000 UTC m=+140.032590192" lastFinishedPulling="2026-05-29 00:49:36.303521126 +0000 UTC m=+140.914592438" observedRunningTime="2026-05-29 00:49:37.506973518 +0000 UTC m=+142.118044853" watchObservedRunningTime="2026-05-29 00:49:37.508716362 +0000 UTC m=+142.119787696" May 29 00:49:38.866259 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.866224 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-744dd9ff75-pt79r"] May 29 00:49:38.868972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.868946 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.871571 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.871539 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 00:49:38.872474 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.872449 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 29 00:49:38.872592 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.872478 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 29 00:49:38.872592 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.872564 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-svl27\"" May 29 00:49:38.872711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.872671 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-41t2lfkunao36\"" May 29 00:49:38.872757 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.872734 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 29 00:49:38.878765 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.878739 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-744dd9ff75-pt79r"] May 29 00:49:38.967531 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/050ccf78-87a3-4925-9ee6-02c42f880979-audit-log\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967537 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-client-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967561 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-tls\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967621 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967579 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967716 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-client-certs\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967716 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5sqd\" (UniqueName: \"kubernetes.io/projected/050ccf78-87a3-4925-9ee6-02c42f880979-kube-api-access-w5sqd\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:38.967799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:38.967722 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-metrics-server-audit-profiles\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.068924 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.068896 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/050ccf78-87a3-4925-9ee6-02c42f880979-audit-log\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.068986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.068931 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-client-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.068986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.068953 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-tls\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.068986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.068969 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.069076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.069001 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-client-certs\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.069076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.069017 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5sqd\" (UniqueName: \"kubernetes.io/projected/050ccf78-87a3-4925-9ee6-02c42f880979-kube-api-access-w5sqd\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.069076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.069042 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-metrics-server-audit-profiles\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.069425 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.069388 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/050ccf78-87a3-4925-9ee6-02c42f880979-audit-log\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.069864 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.069837 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.070044 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.070026 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/050ccf78-87a3-4925-9ee6-02c42f880979-metrics-server-audit-profiles\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.071530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.071502 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-client-certs\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.071642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.071625 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-client-ca-bundle\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.071682 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.071658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/050ccf78-87a3-4925-9ee6-02c42f880979-secret-metrics-server-tls\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.079047 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.079023 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5sqd\" (UniqueName: \"kubernetes.io/projected/050ccf78-87a3-4925-9ee6-02c42f880979-kube-api-access-w5sqd\") pod \"metrics-server-744dd9ff75-pt79r\" (UID: \"050ccf78-87a3-4925-9ee6-02c42f880979\") " pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.180801 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.180738 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:39.301104 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.301075 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-744dd9ff75-pt79r"] May 29 00:49:39.304018 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:49:39.303992 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050ccf78_87a3_4925_9ee6_02c42f880979.slice/crio-f429ae9e575f062f9f091da82bd1ca9b944321863c642c347922cfea731fe45b WatchSource:0}: Error finding container f429ae9e575f062f9f091da82bd1ca9b944321863c642c347922cfea731fe45b: Status 404 returned error can't find the container with id f429ae9e575f062f9f091da82bd1ca9b944321863c642c347922cfea731fe45b May 29 00:49:39.496786 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:39.496746 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" event={"ID":"050ccf78-87a3-4925-9ee6-02c42f880979","Type":"ContainerStarted","Data":"f429ae9e575f062f9f091da82bd1ca9b944321863c642c347922cfea731fe45b"} May 29 00:49:41.503015 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:41.502979 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" event={"ID":"050ccf78-87a3-4925-9ee6-02c42f880979","Type":"ContainerStarted","Data":"55d97b48b79f984c26e7ab023aef1aaee7320f36a201f24c8024b569ddbd25fe"} May 29 00:49:41.521768 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:41.521721 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" podStartSLOduration=2.138765966 podStartE2EDuration="3.52170847s" podCreationTimestamp="2026-05-29 00:49:38 +0000 UTC" firstStartedPulling="2026-05-29 00:49:39.305827034 +0000 UTC m=+143.916898346" lastFinishedPulling="2026-05-29 00:49:40.688769536 +0000 UTC m=+145.299840850" observedRunningTime="2026-05-29 00:49:41.519496668 +0000 UTC m=+146.130568000" watchObservedRunningTime="2026-05-29 00:49:41.52170847 +0000 UTC m=+146.132779802" May 29 00:49:42.933054 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:42.933016 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:49:42.933398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:42.933076 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:49:44.450040 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:44.450007 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:49:44.450456 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:44.450060 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:49:52.932681 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:52.932650 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:49:52.933132 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:52.932704 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:49:54.450192 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:54.450151 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:49:54.450571 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:54.450199 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:49:55.693247 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:49:55.693211 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-24zsk" podUID="f769af73-0a5d-4f6b-b238-d864ffc6f0ce" May 29 00:49:55.699363 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:49:55.699331 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dwlss" podUID="1ece5a88-26a8-4a7a-8298-a19644ca0034" May 29 00:49:56.539265 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:56.539236 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:49:56.539466 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:56.539244 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24zsk" May 29 00:49:58.486427 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:58.486378 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" podUID="93fbc315-543b-41cc-8541-aab12dbb9439" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 00:49:59.181588 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:59.181558 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:49:59.181588 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:49:59.181594 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:50:00.618228 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.618191 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:50:00.618617 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.618238 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:50:00.620794 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.620751 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f769af73-0a5d-4f6b-b238-d864ffc6f0ce-metrics-tls\") pod \"dns-default-24zsk\" (UID: \"f769af73-0a5d-4f6b-b238-d864ffc6f0ce\") " pod="openshift-dns/dns-default-24zsk" May 29 00:50:00.620941 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.620918 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ece5a88-26a8-4a7a-8298-a19644ca0034-cert\") pod \"ingress-canary-dwlss\" (UID: \"1ece5a88-26a8-4a7a-8298-a19644ca0034\") " pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:50:00.742700 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.742677 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7vx5w\"" May 29 00:50:00.743790 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.743759 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nghjs\"" May 29 00:50:00.750682 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.750667 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24zsk" May 29 00:50:00.750833 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.750817 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwlss" May 29 00:50:00.875908 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.875838 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwlss"] May 29 00:50:00.879277 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:50:00.879250 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ece5a88_26a8_4a7a_8298_a19644ca0034.slice/crio-cf45e102ee138fd4bc72e0a0c3b9fa8a5776d440e028f254606f946066f6226e WatchSource:0}: Error finding container cf45e102ee138fd4bc72e0a0c3b9fa8a5776d440e028f254606f946066f6226e: Status 404 returned error can't find the container with id cf45e102ee138fd4bc72e0a0c3b9fa8a5776d440e028f254606f946066f6226e May 29 00:50:00.899995 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:00.899973 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24zsk"] May 29 00:50:00.903332 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:50:00.903302 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf769af73_0a5d_4f6b_b238_d864ffc6f0ce.slice/crio-c14a609a7bcefaa9886506b9eab9ecdec7e3763320d8d428bfd32dfaa1ab083c WatchSource:0}: Error finding container c14a609a7bcefaa9886506b9eab9ecdec7e3763320d8d428bfd32dfaa1ab083c: Status 404 returned error can't find the container with id c14a609a7bcefaa9886506b9eab9ecdec7e3763320d8d428bfd32dfaa1ab083c May 29 00:50:01.553652 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:01.553609 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwlss" event={"ID":"1ece5a88-26a8-4a7a-8298-a19644ca0034","Type":"ContainerStarted","Data":"cf45e102ee138fd4bc72e0a0c3b9fa8a5776d440e028f254606f946066f6226e"} May 29 00:50:01.554722 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:01.554692 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24zsk" event={"ID":"f769af73-0a5d-4f6b-b238-d864ffc6f0ce","Type":"ContainerStarted","Data":"c14a609a7bcefaa9886506b9eab9ecdec7e3763320d8d428bfd32dfaa1ab083c"} May 29 00:50:02.932684 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.932645 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:50:02.933018 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.932700 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:50:02.933018 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.932746 2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:50:02.933374 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.933317 2570 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"150692e6019808dd91d0bc9ecfb21699e09d4d1e9222667bf0032c0c1677ca6a"} pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" containerMessage="Container registry failed liveness probe, will be restarted" May 29 00:50:02.937276 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.937174 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:50:02.937276 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:02.937215 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:50:03.561901 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.561864 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24zsk" event={"ID":"f769af73-0a5d-4f6b-b238-d864ffc6f0ce","Type":"ContainerStarted","Data":"1495bdecb2ff86d29b882ae7d7873283b2c014759a33161cab58ed29e129b49b"} May 29 00:50:03.561901 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.561899 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24zsk" event={"ID":"f769af73-0a5d-4f6b-b238-d864ffc6f0ce","Type":"ContainerStarted","Data":"d8258d469edfedfe0e5b76430fb4499162c1bcc6a7b5bdf8bb16c4a7178f11de"} May 29 00:50:03.562233 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.561968 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-24zsk" May 29 00:50:03.563321 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.563296 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwlss" event={"ID":"1ece5a88-26a8-4a7a-8298-a19644ca0034","Type":"ContainerStarted","Data":"afe5c40ef35561351dc434bec2a39ed7159b3a0615ab159b4b2ba5913bbe9c47"} May 29 00:50:03.577825 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.577765 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-24zsk" podStartSLOduration=129.728843094 podStartE2EDuration="2m11.577750741s" podCreationTimestamp="2026-05-29 00:47:52 +0000 UTC" firstStartedPulling="2026-05-29 00:50:00.904932433 +0000 UTC m=+165.516003744" lastFinishedPulling="2026-05-29 00:50:02.753840078 +0000 UTC m=+167.364911391" observedRunningTime="2026-05-29 00:50:03.577374622 +0000 UTC m=+168.188445968" watchObservedRunningTime="2026-05-29 00:50:03.577750741 +0000 UTC m=+168.188822073" May 29 00:50:03.595138 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:03.595096 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dwlss" podStartSLOduration=129.722841993 podStartE2EDuration="2m11.595083331s" podCreationTimestamp="2026-05-29 00:47:52 +0000 UTC" firstStartedPulling="2026-05-29 00:50:00.881374048 +0000 UTC m=+165.492445366" lastFinishedPulling="2026-05-29 00:50:02.753615381 +0000 UTC m=+167.364686704" observedRunningTime="2026-05-29 00:50:03.594599171 +0000 UTC m=+168.205670521" watchObservedRunningTime="2026-05-29 00:50:03.595083331 +0000 UTC m=+168.206154663" May 29 00:50:08.486517 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:08.486422 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" podUID="93fbc315-543b-41cc-8541-aab12dbb9439" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 00:50:12.936866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:12.936829 2570 patch_prober.go:28] interesting pod/image-registry-5fff7f4b85-srh7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 00:50:12.937217 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:12.936885 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 00:50:13.567239 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:13.567207 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-24zsk" May 29 00:50:18.486980 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:18.486925 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" podUID="93fbc315-543b-41cc-8541-aab12dbb9439" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 00:50:18.487568 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:18.487501 2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" May 29 00:50:18.492659 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:18.492625 2570 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"dafb99bddb5f4829525851ac3adf7b8690e9b7d5d5a33f78c15fb16119682757"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 29 00:50:18.492845 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:18.492678 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" podUID="93fbc315-543b-41cc-8541-aab12dbb9439" containerName="service-proxy" containerID="cri-o://dafb99bddb5f4829525851ac3adf7b8690e9b7d5d5a33f78c15fb16119682757" gracePeriod=30 May 29 00:50:19.186873 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:19.186845 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:50:19.191059 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:19.191030 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-744dd9ff75-pt79r" May 29 00:50:19.607888 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:19.607858 2570 generic.go:358] "Generic (PLEG): container finished" podID="93fbc315-543b-41cc-8541-aab12dbb9439" containerID="dafb99bddb5f4829525851ac3adf7b8690e9b7d5d5a33f78c15fb16119682757" exitCode=2 May 29 00:50:19.608256 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:19.607929 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerDied","Data":"dafb99bddb5f4829525851ac3adf7b8690e9b7d5d5a33f78c15fb16119682757"} May 29 00:50:19.608256 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:19.607965 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccf97fc8b-q4mrf" event={"ID":"93fbc315-543b-41cc-8541-aab12dbb9439","Type":"ContainerStarted","Data":"294b4d2fb7e642732cd333eb1a53577adb6d4378793e0dda404d311f57a57864"} May 29 00:50:22.937456 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:22.937431 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:50:27.953086 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:27.953036 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" podUID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerName="registry" containerID="cri-o://150692e6019808dd91d0bc9ecfb21699e09d4d1e9222667bf0032c0c1677ca6a" gracePeriod=30 May 29 00:50:29.635822 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:29.635786 2570 generic.go:358] "Generic (PLEG): container finished" podID="da7fde44-11fe-4d62-af91-9e1a90ed1bbd" containerID="150692e6019808dd91d0bc9ecfb21699e09d4d1e9222667bf0032c0c1677ca6a" exitCode=0 May 29 00:50:29.636206 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:29.635879 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" event={"ID":"da7fde44-11fe-4d62-af91-9e1a90ed1bbd","Type":"ContainerDied","Data":"150692e6019808dd91d0bc9ecfb21699e09d4d1e9222667bf0032c0c1677ca6a"} May 29 00:50:29.636206 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:29.635915 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" event={"ID":"da7fde44-11fe-4d62-af91-9e1a90ed1bbd","Type":"ContainerStarted","Data":"e993b1cc7065ba1b6d7b890dcf4ab6ecaad3141281ef8aaf5e4fd9f759fd5eae"} May 29 00:50:29.636206 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:29.635964 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:50:50.645834 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:50:50.645805 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fff7f4b85-srh7j" May 29 00:51:37.640032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.639814 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74"] May 29 00:51:37.643314 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.643289 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.645817 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.645790 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:51:37.646918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.646896 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:51:37.647088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.646917 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:51:37.648420 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.648400 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74"] May 29 00:51:37.759735 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.759698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.759960 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.759841 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.759960 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.759907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpx7n\" (UniqueName: \"kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.860826 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.860760 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.860826 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.860826 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpx7n\" (UniqueName: \"kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.861105 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.860853 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.861204 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.861181 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.861204 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.861196 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.869612 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.869584 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpx7n\" (UniqueName: \"kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:37.952846 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:37.952728 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:38.079857 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:38.079762 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74"] May 29 00:51:38.082512 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:51:38.082479 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a805c7_4fb8_474b_9767_e34bd330acef.slice/crio-28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e WatchSource:0}: Error finding container 28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e: Status 404 returned error can't find the container with id 28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e May 29 00:51:38.814764 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:38.814726 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" event={"ID":"c7a805c7-4fb8-474b-9767-e34bd330acef","Type":"ContainerStarted","Data":"28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e"} May 29 00:51:45.835088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:45.835050 2570 generic.go:358] "Generic (PLEG): container finished" podID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerID="1a06f79e00497b71ae1f366635f404ea94da5cc50bd759bf2766c3b2b33cc993" exitCode=0 May 29 00:51:45.835584 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:45.835151 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" event={"ID":"c7a805c7-4fb8-474b-9767-e34bd330acef","Type":"ContainerDied","Data":"1a06f79e00497b71ae1f366635f404ea94da5cc50bd759bf2766c3b2b33cc993"} May 29 00:51:47.841674 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:47.841642 2570 generic.go:358] "Generic (PLEG): container finished" podID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerID="d24de85b98af0e51997e5285723ba37c5595c3f290f162cbdb6eb04602425bf5" exitCode=0 May 29 00:51:47.842063 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:47.841691 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" event={"ID":"c7a805c7-4fb8-474b-9767-e34bd330acef","Type":"ContainerDied","Data":"d24de85b98af0e51997e5285723ba37c5595c3f290f162cbdb6eb04602425bf5"} May 29 00:51:55.864527 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:55.864494 2570 generic.go:358] "Generic (PLEG): container finished" podID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerID="811d1c2f93af7faefa70586f64b301b2cafe9fe1a49fb472780194032ae356fb" exitCode=0 May 29 00:51:55.864922 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:55.864558 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" event={"ID":"c7a805c7-4fb8-474b-9767-e34bd330acef","Type":"ContainerDied","Data":"811d1c2f93af7faefa70586f64b301b2cafe9fe1a49fb472780194032ae356fb"} May 29 00:51:56.986345 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:56.986323 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:51:57.016957 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.016936 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpx7n\" (UniqueName: \"kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n\") pod \"c7a805c7-4fb8-474b-9767-e34bd330acef\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " May 29 00:51:57.017062 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.017019 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util\") pod \"c7a805c7-4fb8-474b-9767-e34bd330acef\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " May 29 00:51:57.017062 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.017048 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle\") pod \"c7a805c7-4fb8-474b-9767-e34bd330acef\" (UID: \"c7a805c7-4fb8-474b-9767-e34bd330acef\") " May 29 00:51:57.017940 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.017901 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle" (OuterVolumeSpecName: "bundle") pod "c7a805c7-4fb8-474b-9767-e34bd330acef" (UID: "c7a805c7-4fb8-474b-9767-e34bd330acef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:51:57.018911 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.018882 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n" (OuterVolumeSpecName: "kube-api-access-zpx7n") pod "c7a805c7-4fb8-474b-9767-e34bd330acef" (UID: "c7a805c7-4fb8-474b-9767-e34bd330acef"). InnerVolumeSpecName "kube-api-access-zpx7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:51:57.021053 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.021034 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util" (OuterVolumeSpecName: "util") pod "c7a805c7-4fb8-474b-9767-e34bd330acef" (UID: "c7a805c7-4fb8-474b-9767-e34bd330acef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:51:57.117592 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.117558 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:51:57.117592 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.117592 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpx7n\" (UniqueName: \"kubernetes.io/projected/c7a805c7-4fb8-474b-9767-e34bd330acef-kube-api-access-zpx7n\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:51:57.117726 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.117602 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7a805c7-4fb8-474b-9767-e34bd330acef-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:51:57.871608 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.871571 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" event={"ID":"c7a805c7-4fb8-474b-9767-e34bd330acef","Type":"ContainerDied","Data":"28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e"} May 29 00:51:57.871608 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.871610 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28ea6b79214f9fb58dbd2395d2c549141a34034ae82fba50d84fc1514b4ba81e" May 29 00:51:57.871829 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:51:57.871629 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgph74" May 29 00:52:09.761435 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761398 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b"] May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761692 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="util" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761707 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="util" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761727 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="pull" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761732 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="pull" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761739 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="extract" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761744 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="extract" May 29 00:52:09.761885 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.761798 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7a805c7-4fb8-474b-9767-e34bd330acef" containerName="extract" May 29 00:52:09.763831 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.763817 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.766307 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.766283 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:52:09.766558 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.766542 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:52:09.767414 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.767399 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:52:09.773561 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.773543 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b"] May 29 00:52:09.806288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.806263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.806404 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.806318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbrv8\" (UniqueName: \"kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.806404 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.806387 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.906733 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.906703 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.906882 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.906756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.906882 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.906834 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbrv8\" (UniqueName: \"kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.907067 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.907047 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.907130 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.907087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:09.916287 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:09.916258 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbrv8\" (UniqueName: \"kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:10.072466 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:10.072376 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:10.190406 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:10.190379 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b"] May 29 00:52:10.193383 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:52:10.193359 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077796a5_160d_4844_b541_16b17bbbe092.slice/crio-670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea WatchSource:0}: Error finding container 670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea: Status 404 returned error can't find the container with id 670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea May 29 00:52:10.902641 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:10.902603 2570 generic.go:358] "Generic (PLEG): container finished" podID="077796a5-160d-4844-b541-16b17bbbe092" containerID="745a3fe7e69c21d9032ca7cdc0b63bd398ec6ffdd8e6764cf9f30c52c3e6ed9d" exitCode=0 May 29 00:52:10.903044 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:10.902648 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerDied","Data":"745a3fe7e69c21d9032ca7cdc0b63bd398ec6ffdd8e6764cf9f30c52c3e6ed9d"} May 29 00:52:10.903044 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:10.902674 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerStarted","Data":"670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea"} May 29 00:52:12.910048 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:12.910022 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerStarted","Data":"bd03daf5af34ae574cbcb9f6643e6f4de581142920ff1ac3c8e097073c99d26f"} May 29 00:52:13.913897 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:13.913859 2570 generic.go:358] "Generic (PLEG): container finished" podID="077796a5-160d-4844-b541-16b17bbbe092" containerID="bd03daf5af34ae574cbcb9f6643e6f4de581142920ff1ac3c8e097073c99d26f" exitCode=0 May 29 00:52:13.914284 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:13.914131 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerDied","Data":"bd03daf5af34ae574cbcb9f6643e6f4de581142920ff1ac3c8e097073c99d26f"} May 29 00:52:14.918317 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:14.918279 2570 generic.go:358] "Generic (PLEG): container finished" podID="077796a5-160d-4844-b541-16b17bbbe092" containerID="abd06967af748461c9befb662a1573042253ff5dc9656520d7c35435b0a475e9" exitCode=0 May 29 00:52:14.918761 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:14.918334 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerDied","Data":"abd06967af748461c9befb662a1573042253ff5dc9656520d7c35435b0a475e9"} May 29 00:52:15.976606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:15.976578 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:52:15.977448 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:15.977426 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:52:15.981808 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:15.981741 2570 kubelet.go:1628] "Image garbage collection succeeded" May 29 00:52:16.044584 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.044564 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:16.148440 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.148402 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbrv8\" (UniqueName: \"kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8\") pod \"077796a5-160d-4844-b541-16b17bbbe092\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " May 29 00:52:16.148440 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.148446 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle\") pod \"077796a5-160d-4844-b541-16b17bbbe092\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " May 29 00:52:16.148612 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.148476 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util\") pod \"077796a5-160d-4844-b541-16b17bbbe092\" (UID: \"077796a5-160d-4844-b541-16b17bbbe092\") " May 29 00:52:16.148866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.148837 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle" (OuterVolumeSpecName: "bundle") pod "077796a5-160d-4844-b541-16b17bbbe092" (UID: "077796a5-160d-4844-b541-16b17bbbe092"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:16.150202 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.150180 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8" (OuterVolumeSpecName: "kube-api-access-gbrv8") pod "077796a5-160d-4844-b541-16b17bbbe092" (UID: "077796a5-160d-4844-b541-16b17bbbe092"). InnerVolumeSpecName "kube-api-access-gbrv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:52:16.153295 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.153155 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util" (OuterVolumeSpecName: "util") pod "077796a5-160d-4844-b541-16b17bbbe092" (UID: "077796a5-160d-4844-b541-16b17bbbe092"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:16.249088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.249060 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbrv8\" (UniqueName: \"kubernetes.io/projected/077796a5-160d-4844-b541-16b17bbbe092-kube-api-access-gbrv8\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:16.249088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.249087 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:16.249242 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.249101 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077796a5-160d-4844-b541-16b17bbbe092-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:16.924923 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.924891 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" event={"ID":"077796a5-160d-4844-b541-16b17bbbe092","Type":"ContainerDied","Data":"670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea"} May 29 00:52:16.925076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.924928 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="670eb52606b4dd577ae883848b92b61f9cf1f500e4b63bdb6abdddf3cef84aea" May 29 00:52:16.925076 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:16.924960 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2zn9b" May 29 00:52:29.871157 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871117 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x"] May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871338 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="pull" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871348 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="pull" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871359 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="util" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871364 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="util" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871369 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="extract" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871374 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="extract" May 29 00:52:29.871536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.871418 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="077796a5-160d-4844-b541-16b17bbbe092" containerName="extract" May 29 00:52:29.873597 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.873583 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:29.876338 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.876319 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:52:29.876433 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.876319 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:52:29.877810 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.877763 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:52:29.883916 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.883874 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x"] May 29 00:52:29.940980 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.940954 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:29.941119 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.940988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ngd\" (UniqueName: \"kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:29.941119 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:29.941091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.041892 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.041856 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.041892 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.041892 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62ngd\" (UniqueName: \"kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.042069 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.041959 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.042350 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.042335 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.042384 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.042368 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.049698 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.049671 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ngd\" (UniqueName: \"kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.182081 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.182011 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:30.297835 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.297805 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x"] May 29 00:52:30.305234 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.305208 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:52:30.963610 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.963573 2570 generic.go:358] "Generic (PLEG): container finished" podID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerID="aeb9060665d84c07793f56e999a24ad69493fdb13459a21bef8eb1dd6ae17cad" exitCode=0 May 29 00:52:30.963972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.963655 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" event={"ID":"060c2261-a50c-4a71-8142-ca4cb8da1e80","Type":"ContainerDied","Data":"aeb9060665d84c07793f56e999a24ad69493fdb13459a21bef8eb1dd6ae17cad"} May 29 00:52:30.963972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:30.963684 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" event={"ID":"060c2261-a50c-4a71-8142-ca4cb8da1e80","Type":"ContainerStarted","Data":"085da5895f923f7b623acd5136d8a8ee606edf1bf5348979c281045db5aed404"} May 29 00:52:31.968207 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:31.968125 2570 generic.go:358] "Generic (PLEG): container finished" podID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerID="baa1e48e7857a23121a404bd24dc938be0bbf15c8f8f70f918556c8fdd1b0d50" exitCode=0 May 29 00:52:31.968207 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:31.968183 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" event={"ID":"060c2261-a50c-4a71-8142-ca4cb8da1e80","Type":"ContainerDied","Data":"baa1e48e7857a23121a404bd24dc938be0bbf15c8f8f70f918556c8fdd1b0d50"} May 29 00:52:32.972368 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:32.972335 2570 generic.go:358] "Generic (PLEG): container finished" podID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerID="5b9764f861d352ddd2dee871e8fbaacc3bd7cf69b55715f5b8fe163b308089ef" exitCode=0 May 29 00:52:32.972713 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:32.972409 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" event={"ID":"060c2261-a50c-4a71-8142-ca4cb8da1e80","Type":"ContainerDied","Data":"5b9764f861d352ddd2dee871e8fbaacc3bd7cf69b55715f5b8fe163b308089ef"} May 29 00:52:34.094648 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.094625 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:34.171431 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.171398 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util\") pod \"060c2261-a50c-4a71-8142-ca4cb8da1e80\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " May 29 00:52:34.171431 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.171437 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle\") pod \"060c2261-a50c-4a71-8142-ca4cb8da1e80\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " May 29 00:52:34.171640 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.171455 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62ngd\" (UniqueName: \"kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd\") pod \"060c2261-a50c-4a71-8142-ca4cb8da1e80\" (UID: \"060c2261-a50c-4a71-8142-ca4cb8da1e80\") " May 29 00:52:34.172070 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.172036 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle" (OuterVolumeSpecName: "bundle") pod "060c2261-a50c-4a71-8142-ca4cb8da1e80" (UID: "060c2261-a50c-4a71-8142-ca4cb8da1e80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:34.173397 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.173375 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd" (OuterVolumeSpecName: "kube-api-access-62ngd") pod "060c2261-a50c-4a71-8142-ca4cb8da1e80" (UID: "060c2261-a50c-4a71-8142-ca4cb8da1e80"). InnerVolumeSpecName "kube-api-access-62ngd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:52:34.177099 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.177066 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util" (OuterVolumeSpecName: "util") pod "060c2261-a50c-4a71-8142-ca4cb8da1e80" (UID: "060c2261-a50c-4a71-8142-ca4cb8da1e80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:34.272372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.272325 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:34.272372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.272347 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/060c2261-a50c-4a71-8142-ca4cb8da1e80-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:34.272372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.272356 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62ngd\" (UniqueName: \"kubernetes.io/projected/060c2261-a50c-4a71-8142-ca4cb8da1e80-kube-api-access-62ngd\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:34.980407 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.980370 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" event={"ID":"060c2261-a50c-4a71-8142-ca4cb8da1e80","Type":"ContainerDied","Data":"085da5895f923f7b623acd5136d8a8ee606edf1bf5348979c281045db5aed404"} May 29 00:52:34.980407 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.980399 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5k467x" May 29 00:52:34.980611 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:34.980404 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="085da5895f923f7b623acd5136d8a8ee606edf1bf5348979c281045db5aed404" May 29 00:52:45.891638 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891602 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8"] May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891835 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="pull" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891845 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="pull" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891860 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="extract" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891866 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="extract" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891873 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="util" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891878 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="util" May 29 00:52:45.892089 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.891914 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="060c2261-a50c-4a71-8142-ca4cb8da1e80" containerName="extract" May 29 00:52:45.898898 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.898877 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:45.901534 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.901507 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:52:45.901897 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.901862 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:52:45.902006 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.901973 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:52:45.902643 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:45.902626 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8"] May 29 00:52:46.047546 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.047523 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dmt\" (UniqueName: \"kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.047658 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.047553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.047658 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.047602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.148615 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.148541 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dmt\" (UniqueName: \"kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.148615 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.148577 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.148840 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.148765 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.148996 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.148977 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.149049 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.149024 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.157027 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.157007 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dmt\" (UniqueName: \"kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.208179 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.208158 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:46.330536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:46.330511 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8"] May 29 00:52:46.332933 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:52:46.332896 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc210f392_7c3c_4f06_b983_609fdbbc9213.slice/crio-b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934 WatchSource:0}: Error finding container b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934: Status 404 returned error can't find the container with id b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934 May 29 00:52:47.014564 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.014522 2570 generic.go:358] "Generic (PLEG): container finished" podID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerID="21d7fc72dd24b98847047e784ab8112b5086f91c7025f023306d5268c343993c" exitCode=0 May 29 00:52:47.014989 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.014610 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" event={"ID":"c210f392-7c3c-4f06-b983-609fdbbc9213","Type":"ContainerDied","Data":"21d7fc72dd24b98847047e784ab8112b5086f91c7025f023306d5268c343993c"} May 29 00:52:47.014989 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.014652 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" event={"ID":"c210f392-7c3c-4f06-b983-609fdbbc9213","Type":"ContainerStarted","Data":"b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934"} May 29 00:52:47.200659 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.200623 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db"] May 29 00:52:47.203830 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.203811 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.206541 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.206518 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 00:52:47.206646 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.206518 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 00:52:47.206705 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.206687 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 00:52:47.206823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.206804 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 00:52:47.207061 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.207046 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-km7r4\"" May 29 00:52:47.214126 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.214102 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db"] May 29 00:52:47.357549 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.357496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.357549 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.357526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7h7d\" (UniqueName: \"kubernetes.io/projected/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-kube-api-access-w7h7d\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.357680 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.357566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.458526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.458501 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.458616 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.458532 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7h7d\" (UniqueName: \"kubernetes.io/projected/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-kube-api-access-w7h7d\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.458616 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.458569 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.461070 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.461044 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.461157 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.461108 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.465968 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.465949 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7h7d\" (UniqueName: \"kubernetes.io/projected/6e8a6216-87ae-4473-b9cf-5d9013bf66cb-kube-api-access-w7h7d\") pod \"opendatahub-operator-controller-manager-d9b8687fd-jc2db\" (UID: \"6e8a6216-87ae-4473-b9cf-5d9013bf66cb\") " pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.514335 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.514314 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:47.650018 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:47.649994 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db"] May 29 00:52:47.653215 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:52:47.653188 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8a6216_87ae_4473_b9cf_5d9013bf66cb.slice/crio-7fa5778ff2c48848533c3d89ede6625217cdd516721d724096cdbffca7d2f786 WatchSource:0}: Error finding container 7fa5778ff2c48848533c3d89ede6625217cdd516721d724096cdbffca7d2f786: Status 404 returned error can't find the container with id 7fa5778ff2c48848533c3d89ede6625217cdd516721d724096cdbffca7d2f786 May 29 00:52:48.019823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:48.019793 2570 generic.go:358] "Generic (PLEG): container finished" podID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerID="ed19514ed7f4896e9be58c32b1fdff53010395a867e75891b4ea36bf19f152a5" exitCode=0 May 29 00:52:48.020150 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:48.019872 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" event={"ID":"c210f392-7c3c-4f06-b983-609fdbbc9213","Type":"ContainerDied","Data":"ed19514ed7f4896e9be58c32b1fdff53010395a867e75891b4ea36bf19f152a5"} May 29 00:52:48.021097 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:48.021074 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" event={"ID":"6e8a6216-87ae-4473-b9cf-5d9013bf66cb","Type":"ContainerStarted","Data":"7fa5778ff2c48848533c3d89ede6625217cdd516721d724096cdbffca7d2f786"} May 29 00:52:49.026938 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:49.026899 2570 generic.go:358] "Generic (PLEG): container finished" podID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerID="b3715cdb1726dcbf088208bd9bf0ad61a51cdeec7440ccbb99d69ce2c13fc381" exitCode=0 May 29 00:52:49.027367 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:49.026970 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" event={"ID":"c210f392-7c3c-4f06-b983-609fdbbc9213","Type":"ContainerDied","Data":"b3715cdb1726dcbf088208bd9bf0ad61a51cdeec7440ccbb99d69ce2c13fc381"} May 29 00:52:50.292607 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.292585 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:50.378637 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.378615 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle\") pod \"c210f392-7c3c-4f06-b983-609fdbbc9213\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " May 29 00:52:50.378737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.378652 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5dmt\" (UniqueName: \"kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt\") pod \"c210f392-7c3c-4f06-b983-609fdbbc9213\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " May 29 00:52:50.378737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.378683 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util\") pod \"c210f392-7c3c-4f06-b983-609fdbbc9213\" (UID: \"c210f392-7c3c-4f06-b983-609fdbbc9213\") " May 29 00:52:50.379354 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.379331 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle" (OuterVolumeSpecName: "bundle") pod "c210f392-7c3c-4f06-b983-609fdbbc9213" (UID: "c210f392-7c3c-4f06-b983-609fdbbc9213"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:50.380543 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.380520 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt" (OuterVolumeSpecName: "kube-api-access-r5dmt") pod "c210f392-7c3c-4f06-b983-609fdbbc9213" (UID: "c210f392-7c3c-4f06-b983-609fdbbc9213"). InnerVolumeSpecName "kube-api-access-r5dmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:52:50.384651 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.384593 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util" (OuterVolumeSpecName: "util") pod "c210f392-7c3c-4f06-b983-609fdbbc9213" (UID: "c210f392-7c3c-4f06-b983-609fdbbc9213"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:52:50.479586 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.479564 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:50.479586 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.479585 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c210f392-7c3c-4f06-b983-609fdbbc9213-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:50.479706 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:50.479594 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5dmt\" (UniqueName: \"kubernetes.io/projected/c210f392-7c3c-4f06-b983-609fdbbc9213-kube-api-access-r5dmt\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:52:51.035018 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.034989 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" May 29 00:52:51.035178 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.034984 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c97thf8" event={"ID":"c210f392-7c3c-4f06-b983-609fdbbc9213","Type":"ContainerDied","Data":"b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934"} May 29 00:52:51.035178 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.035148 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b302672d6f661b079bbf05bd6448f8231ec6e814b8d5007bb2c7a65683770934" May 29 00:52:51.036463 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.036434 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" event={"ID":"6e8a6216-87ae-4473-b9cf-5d9013bf66cb","Type":"ContainerStarted","Data":"938ef137daca1765e64a89906b5abaa38a8c5206b7199dfb1c32973435551832"} May 29 00:52:51.036594 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.036580 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:52:51.059528 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:51.059485 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" podStartSLOduration=1.389526639 podStartE2EDuration="4.05947444s" podCreationTimestamp="2026-05-29 00:52:47 +0000 UTC" firstStartedPulling="2026-05-29 00:52:47.654878606 +0000 UTC m=+332.265949917" lastFinishedPulling="2026-05-29 00:52:50.324826391 +0000 UTC m=+334.935897718" observedRunningTime="2026-05-29 00:52:51.057328458 +0000 UTC m=+335.668399791" watchObservedRunningTime="2026-05-29 00:52:51.05947444 +0000 UTC m=+335.670545773" May 29 00:52:54.955328 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955294 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9"] May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955625 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="util" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955641 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="util" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955657 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="pull" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955665 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="pull" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955674 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="extract" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955681 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="extract" May 29 00:52:54.955799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.955748 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="c210f392-7c3c-4f06-b983-609fdbbc9213" containerName="extract" May 29 00:52:54.958864 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.958845 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:54.961323 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.961291 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 29 00:52:54.962567 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.962541 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 29 00:52:54.962687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.962576 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 29 00:52:54.962687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.962582 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nlh75\"" May 29 00:52:54.962687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.962543 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 29 00:52:54.962687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.962553 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 29 00:52:54.967870 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:54.967843 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9"] May 29 00:52:55.112873 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.112845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdszj\" (UniqueName: \"kubernetes.io/projected/45cb1298-5c46-464d-9eb0-850b0a66c10b-kube-api-access-wdszj\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.112999 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.112889 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45cb1298-5c46-464d-9eb0-850b0a66c10b-manager-config\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.112999 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.112916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-metrics-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.112999 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.112970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.213806 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.213741 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.213899 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.213811 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdszj\" (UniqueName: \"kubernetes.io/projected/45cb1298-5c46-464d-9eb0-850b0a66c10b-kube-api-access-wdszj\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.213899 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.213837 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45cb1298-5c46-464d-9eb0-850b0a66c10b-manager-config\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.213899 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.213857 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-metrics-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.214492 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.214463 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45cb1298-5c46-464d-9eb0-850b0a66c10b-manager-config\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.216086 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.216064 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.216325 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.216303 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45cb1298-5c46-464d-9eb0-850b0a66c10b-metrics-cert\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.221819 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.221794 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdszj\" (UniqueName: \"kubernetes.io/projected/45cb1298-5c46-464d-9eb0-850b0a66c10b-kube-api-access-wdszj\") pod \"lws-controller-manager-55ddb96654-jf9x9\" (UID: \"45cb1298-5c46-464d-9eb0-850b0a66c10b\") " pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.268657 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.268638 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:55.384642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:55.384618 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9"] May 29 00:52:55.386906 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:52:55.386880 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cb1298_5c46_464d_9eb0_850b0a66c10b.slice/crio-b44ebcc5e76a1aeb1003ad005c685f423f9e042eeb29cc704ebaa505c6314499 WatchSource:0}: Error finding container b44ebcc5e76a1aeb1003ad005c685f423f9e042eeb29cc704ebaa505c6314499: Status 404 returned error can't find the container with id b44ebcc5e76a1aeb1003ad005c685f423f9e042eeb29cc704ebaa505c6314499 May 29 00:52:56.052162 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:56.052128 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" event={"ID":"45cb1298-5c46-464d-9eb0-850b0a66c10b","Type":"ContainerStarted","Data":"b44ebcc5e76a1aeb1003ad005c685f423f9e042eeb29cc704ebaa505c6314499"} May 29 00:52:57.056807 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:57.056761 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" event={"ID":"45cb1298-5c46-464d-9eb0-850b0a66c10b","Type":"ContainerStarted","Data":"232f37555b3e188c14fe7c8a49a84164face0983e6bcb22014c3c81561f769dc"} May 29 00:52:57.057147 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:57.056901 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:52:57.071923 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:52:57.071877 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" podStartSLOduration=1.531969429 podStartE2EDuration="3.071864831s" podCreationTimestamp="2026-05-29 00:52:54 +0000 UTC" firstStartedPulling="2026-05-29 00:52:55.388565481 +0000 UTC m=+339.999636791" lastFinishedPulling="2026-05-29 00:52:56.928460867 +0000 UTC m=+341.539532193" observedRunningTime="2026-05-29 00:52:57.071340539 +0000 UTC m=+341.682411872" watchObservedRunningTime="2026-05-29 00:52:57.071864831 +0000 UTC m=+341.682936164" May 29 00:53:02.041866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:02.041835 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d9b8687fd-jc2db" May 29 00:53:06.276978 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.276901 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn"] May 29 00:53:06.279200 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.279184 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.281442 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.281419 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:53:06.282501 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.282485 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:53:06.282548 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.282485 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:53:06.288362 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.288335 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn"] May 29 00:53:06.391526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.391489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmkg\" (UniqueName: \"kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.391637 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.391544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.391637 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.391563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.492979 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.492948 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.493079 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.493008 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmkg\" (UniqueName: \"kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.493079 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.493043 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.493394 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.493370 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.493441 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.493369 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.500705 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.500676 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmkg\" (UniqueName: \"kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.593586 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.593534 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:06.713887 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:06.713861 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn"] May 29 00:53:06.717019 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:53:06.716994 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7bfbb2_af8c_40e0_83c3_ae409a9308fe.slice/crio-18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3 WatchSource:0}: Error finding container 18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3: Status 404 returned error can't find the container with id 18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3 May 29 00:53:07.096454 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:07.096423 2570 generic.go:358] "Generic (PLEG): container finished" podID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerID="a074395cfe8e092a4ad06d5ba4b3ee5bc6b2c015a59b9dcdad1c5f621a8bad4f" exitCode=0 May 29 00:53:07.096591 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:07.096506 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" event={"ID":"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe","Type":"ContainerDied","Data":"a074395cfe8e092a4ad06d5ba4b3ee5bc6b2c015a59b9dcdad1c5f621a8bad4f"} May 29 00:53:07.096591 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:07.096546 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" event={"ID":"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe","Type":"ContainerStarted","Data":"18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3"} May 29 00:53:08.062934 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:08.062905 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55ddb96654-jf9x9" May 29 00:53:09.103065 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:09.103027 2570 generic.go:358] "Generic (PLEG): container finished" podID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerID="3532ff626b328f59fb7ccec8922518d009be6addd94b5783bd9b57baea261b63" exitCode=0 May 29 00:53:09.103426 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:09.103118 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" event={"ID":"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe","Type":"ContainerDied","Data":"3532ff626b328f59fb7ccec8922518d009be6addd94b5783bd9b57baea261b63"} May 29 00:53:10.107598 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:10.107567 2570 generic.go:358] "Generic (PLEG): container finished" podID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerID="6fc1553ae19c1547c3da770eca9c9f2ff4802e9afe5b1ff1b637198cc880c123" exitCode=0 May 29 00:53:10.107957 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:10.107645 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" event={"ID":"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe","Type":"ContainerDied","Data":"6fc1553ae19c1547c3da770eca9c9f2ff4802e9afe5b1ff1b637198cc880c123"} May 29 00:53:11.230013 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.229990 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:11.328674 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.328653 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle\") pod \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " May 29 00:53:11.328812 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.328703 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkmkg\" (UniqueName: \"kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg\") pod \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " May 29 00:53:11.328812 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.328737 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util\") pod \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\" (UID: \"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe\") " May 29 00:53:11.329687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.329656 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle" (OuterVolumeSpecName: "bundle") pod "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" (UID: "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:53:11.330685 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.330666 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg" (OuterVolumeSpecName: "kube-api-access-pkmkg") pod "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" (UID: "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe"). InnerVolumeSpecName "kube-api-access-pkmkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:53:11.334239 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.334196 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util" (OuterVolumeSpecName: "util") pod "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" (UID: "9b7bfbb2-af8c-40e0-83c3-ae409a9308fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:53:11.429799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.429739 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkmkg\" (UniqueName: \"kubernetes.io/projected/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-kube-api-access-pkmkg\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:11.429799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.429760 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:11.429799 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:11.429770 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b7bfbb2-af8c-40e0-83c3-ae409a9308fe-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:12.116697 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:12.116659 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" event={"ID":"9b7bfbb2-af8c-40e0-83c3-ae409a9308fe","Type":"ContainerDied","Data":"18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3"} May 29 00:53:12.116814 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:12.116702 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18b1f0ec00f6065cf0b83e8ac03ab3ba9e2c94e01e207dd365c9a615aa766df3" May 29 00:53:12.116814 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:12.116703 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835j7crn" May 29 00:53:20.844182 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844143 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw"] May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844471 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="util" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844487 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="util" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844501 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="extract" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844510 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="extract" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844527 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="pull" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844536 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="pull" May 29 00:53:20.844737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.844594 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b7bfbb2-af8c-40e0-83c3-ae409a9308fe" containerName="extract" May 29 00:53:20.852788 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.852743 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:20.855991 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.855965 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw"] May 29 00:53:20.859997 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.859971 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:53:20.861149 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.861127 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:53:20.861257 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.861135 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:53:20.993156 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.993126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ds7z\" (UniqueName: \"kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:20.993267 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.993191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:20.993267 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:20.993228 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.093653 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.093623 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.093764 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.093674 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.093764 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.093716 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ds7z\" (UniqueName: \"kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.094027 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.094008 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.094082 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.094043 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.116388 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.116332 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ds7z\" (UniqueName: \"kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.164297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.164277 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:21.298997 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:21.298945 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw"] May 29 00:53:21.303304 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:53:21.303278 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a13a3a5_227c_49ef_a0ef_f12ba52dca28.slice/crio-5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc WatchSource:0}: Error finding container 5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc: Status 404 returned error can't find the container with id 5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc May 29 00:53:22.148403 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:22.148377 2570 generic.go:358] "Generic (PLEG): container finished" podID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerID="44ec7f38e60d7ba64c57461254925af48347b8e0f216be5b42e0558807cba55b" exitCode=0 May 29 00:53:22.148670 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:22.148420 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" event={"ID":"5a13a3a5-227c-49ef-a0ef-f12ba52dca28","Type":"ContainerDied","Data":"44ec7f38e60d7ba64c57461254925af48347b8e0f216be5b42e0558807cba55b"} May 29 00:53:22.148670 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:22.148438 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" event={"ID":"5a13a3a5-227c-49ef-a0ef-f12ba52dca28","Type":"ContainerStarted","Data":"5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc"} May 29 00:53:24.155657 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:24.155623 2570 generic.go:358] "Generic (PLEG): container finished" podID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerID="70699955a225968382be0db0f980a21fc20e4baff89e55e03426568f266f5841" exitCode=0 May 29 00:53:24.156115 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:24.155668 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" event={"ID":"5a13a3a5-227c-49ef-a0ef-f12ba52dca28","Type":"ContainerDied","Data":"70699955a225968382be0db0f980a21fc20e4baff89e55e03426568f266f5841"} May 29 00:53:25.160632 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:25.160589 2570 generic.go:358] "Generic (PLEG): container finished" podID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerID="d024625067313de0862262358468629ceaeec6cc476ed74c64dbe8ec8fdb531a" exitCode=0 May 29 00:53:25.160994 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:25.160648 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" event={"ID":"5a13a3a5-227c-49ef-a0ef-f12ba52dca28","Type":"ContainerDied","Data":"d024625067313de0862262358468629ceaeec6cc476ed74c64dbe8ec8fdb531a"} May 29 00:53:26.277173 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.277153 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:26.430486 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.430432 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util\") pod \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " May 29 00:53:26.430486 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.430473 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ds7z\" (UniqueName: \"kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z\") pod \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " May 29 00:53:26.430626 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.430514 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle\") pod \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\" (UID: \"5a13a3a5-227c-49ef-a0ef-f12ba52dca28\") " May 29 00:53:26.431355 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.431327 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle" (OuterVolumeSpecName: "bundle") pod "5a13a3a5-227c-49ef-a0ef-f12ba52dca28" (UID: "5a13a3a5-227c-49ef-a0ef-f12ba52dca28"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:53:26.432572 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.432546 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z" (OuterVolumeSpecName: "kube-api-access-7ds7z") pod "5a13a3a5-227c-49ef-a0ef-f12ba52dca28" (UID: "5a13a3a5-227c-49ef-a0ef-f12ba52dca28"). InnerVolumeSpecName "kube-api-access-7ds7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:53:26.435577 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.435553 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util" (OuterVolumeSpecName: "util") pod "5a13a3a5-227c-49ef-a0ef-f12ba52dca28" (UID: "5a13a3a5-227c-49ef-a0ef-f12ba52dca28"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:53:26.530994 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.530967 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:26.530994 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.530993 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ds7z\" (UniqueName: \"kubernetes.io/projected/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-kube-api-access-7ds7z\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:26.531148 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:26.531003 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a13a3a5-227c-49ef-a0ef-f12ba52dca28-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:53:27.167991 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:27.167951 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" event={"ID":"5a13a3a5-227c-49ef-a0ef-f12ba52dca28","Type":"ContainerDied","Data":"5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc"} May 29 00:53:27.167991 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:27.167993 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d69454088a20afb74cc0844e91591724b74d01b3de7429fea84de84ff4c02cc" May 29 00:53:27.168187 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:27.168014 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9gfkw" May 29 00:53:37.373178 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373145 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj"] May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373471 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="pull" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373487 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="pull" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373498 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="util" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373506 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="util" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373529 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="extract" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373537 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="extract" May 29 00:53:37.373619 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.373593 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a13a3a5-227c-49ef-a0ef-f12ba52dca28" containerName="extract" May 29 00:53:37.376103 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.376082 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.382957 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.382938 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vcw5b\"" May 29 00:53:37.383927 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.383907 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 00:53:37.384009 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.383972 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 29 00:53:37.384009 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.383994 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 00:53:37.399471 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399547 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399480 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399547 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399499 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399547 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdssd\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-kube-api-access-rdssd\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399844 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399712 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.399844 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.399769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.406086 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.406064 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj"] May 29 00:53:37.500926 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.500902 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501072 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.500946 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501072 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.500972 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501072 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501008 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501072 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501033 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501072 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501057 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501312 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501107 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdssd\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-kube-api-access-rdssd\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501312 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501138 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501312 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501178 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501460 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501326 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501460 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501399 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501548 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501487 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501645 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.501815 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.501770 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.503216 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.503192 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.503429 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.503411 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.522329 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.522302 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.522600 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.522582 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdssd\" (UniqueName: \"kubernetes.io/projected/0a42636a-cf08-4d16-a2b8-2f8ae24a9af8-kube-api-access-rdssd\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj\" (UID: \"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.686000 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.685953 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:37.814236 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:37.814216 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj"] May 29 00:53:37.816171 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:53:37.816142 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a42636a_cf08_4d16_a2b8_2f8ae24a9af8.slice/crio-9456432c405cfb1e11c40fef7fa345d3c9c295c897364db3bb17fda66b37d0e5 WatchSource:0}: Error finding container 9456432c405cfb1e11c40fef7fa345d3c9c295c897364db3bb17fda66b37d0e5: Status 404 returned error can't find the container with id 9456432c405cfb1e11c40fef7fa345d3c9c295c897364db3bb17fda66b37d0e5 May 29 00:53:38.209271 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:38.209235 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" event={"ID":"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8","Type":"ContainerStarted","Data":"9456432c405cfb1e11c40fef7fa345d3c9c295c897364db3bb17fda66b37d0e5"} May 29 00:53:40.739858 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:40.739821 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:53:40.740069 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:40.739895 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:53:40.740069 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:40.739922 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:53:41.222137 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:41.222055 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" event={"ID":"0a42636a-cf08-4d16-a2b8-2f8ae24a9af8","Type":"ContainerStarted","Data":"9e029e906f7d9ec078faf0893e420cf3143f911ee386a79faabba82d668e5c75"} May 29 00:53:41.241918 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:41.241859 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" podStartSLOduration=1.320515973 podStartE2EDuration="4.241842988s" podCreationTimestamp="2026-05-29 00:53:37 +0000 UTC" firstStartedPulling="2026-05-29 00:53:37.818266658 +0000 UTC m=+382.429337972" lastFinishedPulling="2026-05-29 00:53:40.739593677 +0000 UTC m=+385.350664987" observedRunningTime="2026-05-29 00:53:41.240366439 +0000 UTC m=+385.851437771" watchObservedRunningTime="2026-05-29 00:53:41.241842988 +0000 UTC m=+385.852914320" May 29 00:53:41.687032 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:41.686994 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:41.691690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:41.691661 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:42.225423 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:42.225393 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:53:42.226266 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:53:42.226249 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj" May 29 00:54:05.377629 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.377597 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:05.381071 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.381054 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:05.384261 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.384240 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 00:54:05.384372 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.384300 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 00:54:05.384443 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.384423 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fvz94\"" May 29 00:54:05.399040 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.399020 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:05.496416 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.496395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65dzb\" (UniqueName: \"kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb\") pod \"kuadrant-operator-catalog-9khjg\" (UID: \"083820ba-4999-4393-bdbe-5c52ec114016\") " pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:05.596677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.596657 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65dzb\" (UniqueName: \"kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb\") pod \"kuadrant-operator-catalog-9khjg\" (UID: \"083820ba-4999-4393-bdbe-5c52ec114016\") " pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:05.603949 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.603922 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65dzb\" (UniqueName: \"kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb\") pod \"kuadrant-operator-catalog-9khjg\" (UID: \"083820ba-4999-4393-bdbe-5c52ec114016\") " pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:05.690095 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.690045 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:05.720565 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.720538 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:05.803449 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.803423 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:05.806975 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:05.806948 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083820ba_4999_4393_bdbe_5c52ec114016.slice/crio-f345811f6b9e95a7e4b1fb9caab5774de4396f7f771a0d0dde95b54feddfbe28 WatchSource:0}: Error finding container f345811f6b9e95a7e4b1fb9caab5774de4396f7f771a0d0dde95b54feddfbe28: Status 404 returned error can't find the container with id f345811f6b9e95a7e4b1fb9caab5774de4396f7f771a0d0dde95b54feddfbe28 May 29 00:54:05.927106 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.927082 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvp8k"] May 29 00:54:05.930169 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.930154 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:05.937001 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.936987 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvp8k"] May 29 00:54:05.999422 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:05.999400 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2b7\" (UniqueName: \"kubernetes.io/projected/dd64d9f5-4426-44f0-8354-cd3fc589a0c5-kube-api-access-xn2b7\") pod \"kuadrant-operator-catalog-hvp8k\" (UID: \"dd64d9f5-4426-44f0-8354-cd3fc589a0c5\") " pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:06.099839 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:06.099819 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2b7\" (UniqueName: \"kubernetes.io/projected/dd64d9f5-4426-44f0-8354-cd3fc589a0c5-kube-api-access-xn2b7\") pod \"kuadrant-operator-catalog-hvp8k\" (UID: \"dd64d9f5-4426-44f0-8354-cd3fc589a0c5\") " pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:06.107442 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:06.107420 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2b7\" (UniqueName: \"kubernetes.io/projected/dd64d9f5-4426-44f0-8354-cd3fc589a0c5-kube-api-access-xn2b7\") pod \"kuadrant-operator-catalog-hvp8k\" (UID: \"dd64d9f5-4426-44f0-8354-cd3fc589a0c5\") " pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:06.239447 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:06.239423 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:06.310078 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:06.310045 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" event={"ID":"083820ba-4999-4393-bdbe-5c52ec114016","Type":"ContainerStarted","Data":"f345811f6b9e95a7e4b1fb9caab5774de4396f7f771a0d0dde95b54feddfbe28"} May 29 00:54:06.370051 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:06.370024 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvp8k"] May 29 00:54:06.411217 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:06.411190 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd64d9f5_4426_44f0_8354_cd3fc589a0c5.slice/crio-8a0dc04b8a836d6b2b9f02ac3b461127e39d6c9c36def28159bebfdff595e112 WatchSource:0}: Error finding container 8a0dc04b8a836d6b2b9f02ac3b461127e39d6c9c36def28159bebfdff595e112: Status 404 returned error can't find the container with id 8a0dc04b8a836d6b2b9f02ac3b461127e39d6c9c36def28159bebfdff595e112 May 29 00:54:07.316066 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:07.315995 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" event={"ID":"dd64d9f5-4426-44f0-8354-cd3fc589a0c5","Type":"ContainerStarted","Data":"8a0dc04b8a836d6b2b9f02ac3b461127e39d6c9c36def28159bebfdff595e112"} May 29 00:54:08.320707 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.320675 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" event={"ID":"083820ba-4999-4393-bdbe-5c52ec114016","Type":"ContainerStarted","Data":"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c"} May 29 00:54:08.321181 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.320755 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" podUID="083820ba-4999-4393-bdbe-5c52ec114016" containerName="registry-server" containerID="cri-o://20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c" gracePeriod=2 May 29 00:54:08.322092 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.322060 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" event={"ID":"dd64d9f5-4426-44f0-8354-cd3fc589a0c5","Type":"ContainerStarted","Data":"882e5bebcfc01c8be7c898338c6ada3d63bca9a3cc95713bf8b4e25ce09c1bd4"} May 29 00:54:08.335173 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.335132 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" podStartSLOduration=0.981785646 podStartE2EDuration="3.335115181s" podCreationTimestamp="2026-05-29 00:54:05 +0000 UTC" firstStartedPulling="2026-05-29 00:54:05.808154914 +0000 UTC m=+410.419226224" lastFinishedPulling="2026-05-29 00:54:08.161484446 +0000 UTC m=+412.772555759" observedRunningTime="2026-05-29 00:54:08.333547494 +0000 UTC m=+412.944618826" watchObservedRunningTime="2026-05-29 00:54:08.335115181 +0000 UTC m=+412.946186513" May 29 00:54:08.347474 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.347434 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" podStartSLOduration=1.5957625640000002 podStartE2EDuration="3.347423646s" podCreationTimestamp="2026-05-29 00:54:05 +0000 UTC" firstStartedPulling="2026-05-29 00:54:06.412476285 +0000 UTC m=+411.023547598" lastFinishedPulling="2026-05-29 00:54:08.164137369 +0000 UTC m=+412.775208680" observedRunningTime="2026-05-29 00:54:08.346547706 +0000 UTC m=+412.957619039" watchObservedRunningTime="2026-05-29 00:54:08.347423646 +0000 UTC m=+412.958494978" May 29 00:54:08.650450 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.650425 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:08.721523 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.721469 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65dzb\" (UniqueName: \"kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb\") pod \"083820ba-4999-4393-bdbe-5c52ec114016\" (UID: \"083820ba-4999-4393-bdbe-5c52ec114016\") " May 29 00:54:08.723373 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.723351 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb" (OuterVolumeSpecName: "kube-api-access-65dzb") pod "083820ba-4999-4393-bdbe-5c52ec114016" (UID: "083820ba-4999-4393-bdbe-5c52ec114016"). InnerVolumeSpecName "kube-api-access-65dzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:54:08.822855 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:08.822833 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65dzb\" (UniqueName: \"kubernetes.io/projected/083820ba-4999-4393-bdbe-5c52ec114016-kube-api-access-65dzb\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:09.325991 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.325967 2570 generic.go:358] "Generic (PLEG): container finished" podID="083820ba-4999-4393-bdbe-5c52ec114016" containerID="20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c" exitCode=0 May 29 00:54:09.326309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.326019 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" May 29 00:54:09.326309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.326060 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" event={"ID":"083820ba-4999-4393-bdbe-5c52ec114016","Type":"ContainerDied","Data":"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c"} May 29 00:54:09.326309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.326103 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9khjg" event={"ID":"083820ba-4999-4393-bdbe-5c52ec114016","Type":"ContainerDied","Data":"f345811f6b9e95a7e4b1fb9caab5774de4396f7f771a0d0dde95b54feddfbe28"} May 29 00:54:09.326309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.326125 2570 scope.go:117] "RemoveContainer" containerID="20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c" May 29 00:54:09.334124 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.334109 2570 scope.go:117] "RemoveContainer" containerID="20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c" May 29 00:54:09.334364 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:54:09.334348 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c\": container with ID starting with 20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c not found: ID does not exist" containerID="20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c" May 29 00:54:09.334408 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.334372 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c"} err="failed to get container status \"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c\": rpc error: code = NotFound desc = could not find container \"20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c\": container with ID starting with 20d9f331d5b053895a3b8ecd92aaa9b94ab04f726c8d68038ad53f8004c72b9c not found: ID does not exist" May 29 00:54:09.344876 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.344855 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:09.350343 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:09.350326 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9khjg"] May 29 00:54:10.089701 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:10.089676 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083820ba-4999-4393-bdbe-5c52ec114016" path="/var/lib/kubelet/pods/083820ba-4999-4393-bdbe-5c52ec114016/volumes" May 29 00:54:16.240332 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:16.240277 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:16.240332 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:16.240309 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:16.259911 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:16.259888 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:16.364818 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:16.364792 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hvp8k" May 29 00:54:17.362608 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.362579 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9"] May 29 00:54:17.362993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.362846 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="083820ba-4999-4393-bdbe-5c52ec114016" containerName="registry-server" May 29 00:54:17.362993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.362859 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="083820ba-4999-4393-bdbe-5c52ec114016" containerName="registry-server" May 29 00:54:17.362993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.362931 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="083820ba-4999-4393-bdbe-5c52ec114016" containerName="registry-server" May 29 00:54:17.369187 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.369167 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.372521 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.372484 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhbdl\"" May 29 00:54:17.373657 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.373631 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9"] May 29 00:54:17.481895 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.481864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.482027 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.481903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456xt\" (UniqueName: \"kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.482027 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.481922 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.582947 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.582917 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.583084 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.582955 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-456xt\" (UniqueName: \"kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.583084 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.582973 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.583384 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.583359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.583384 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.583376 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.591446 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.591412 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-456xt\" (UniqueName: \"kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.679367 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.679311 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:17.802283 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:17.802263 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9"] May 29 00:54:17.804184 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:17.804158 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d2c63b_544a_4250_bf25_49a75adfdafb.slice/crio-ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52 WatchSource:0}: Error finding container ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52: Status 404 returned error can't find the container with id ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52 May 29 00:54:18.156854 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.156825 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg"] May 29 00:54:18.159585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.159568 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.167724 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.167697 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg"] May 29 00:54:18.187043 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.187018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.187153 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.187057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xztt\" (UniqueName: \"kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.187153 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.187140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.287812 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.287770 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xztt\" (UniqueName: \"kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.287897 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.287821 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.287897 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.287873 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.288141 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.288126 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.288198 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.288179 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.294845 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.294826 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xztt\" (UniqueName: \"kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.354696 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.354666 2570 generic.go:358] "Generic (PLEG): container finished" podID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerID="09073ef36b0fff19ed42d47f6e971fda4e8e46761f665147416d0aa822f798a2" exitCode=0 May 29 00:54:18.354866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.354749 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" event={"ID":"79d2c63b-544a-4250-bf25-49a75adfdafb","Type":"ContainerDied","Data":"09073ef36b0fff19ed42d47f6e971fda4e8e46761f665147416d0aa822f798a2"} May 29 00:54:18.354866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.354798 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" event={"ID":"79d2c63b-544a-4250-bf25-49a75adfdafb","Type":"ContainerStarted","Data":"ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52"} May 29 00:54:18.468580 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.468521 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:18.585148 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.585123 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg"] May 29 00:54:18.587162 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:18.587135 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7152e7_8a49_4b9c_8ca3_405ee49a4642.slice/crio-bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950 WatchSource:0}: Error finding container bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950: Status 404 returned error can't find the container with id bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950 May 29 00:54:18.757647 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.757620 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj"] May 29 00:54:18.760542 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.760525 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.767764 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.767744 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj"] May 29 00:54:18.793438 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.793415 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.793509 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.793451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbml\" (UniqueName: \"kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.793557 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.793510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.894490 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.894462 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbml\" (UniqueName: \"kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.894582 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.894506 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.894644 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.894586 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.894928 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.894908 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.894998 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.894948 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:18.902270 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:18.902248 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbml\" (UniqueName: \"kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:19.068565 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.068506 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:19.187448 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.187421 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj"] May 29 00:54:19.191322 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:19.191297 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b9fa29_67df_41f4_85ea_4792f5c8cc73.slice/crio-340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e WatchSource:0}: Error finding container 340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e: Status 404 returned error can't find the container with id 340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e May 29 00:54:19.359708 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.359673 2570 generic.go:358] "Generic (PLEG): container finished" podID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerID="f5594a961f9976e092e59febc85dea88d2a00c4e98765362389a52f069ad9ae4" exitCode=0 May 29 00:54:19.359846 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.359764 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" event={"ID":"79d2c63b-544a-4250-bf25-49a75adfdafb","Type":"ContainerDied","Data":"f5594a961f9976e092e59febc85dea88d2a00c4e98765362389a52f069ad9ae4"} May 29 00:54:19.360567 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.360432 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d"] May 29 00:54:19.361247 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.361227 2570 generic.go:358] "Generic (PLEG): container finished" podID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerID="2f5bdf37de50d37d015dee9c53e4bdf2132e062435026cdc1d3ad57fff259e88" exitCode=0 May 29 00:54:19.362835 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.362814 2570 generic.go:358] "Generic (PLEG): container finished" podID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerID="8313ad75dd2b18fea295fd3c63598eb54151b5e4d2762eac42f9d36c1fcbc7d6" exitCode=0 May 29 00:54:19.364064 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.364044 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" event={"ID":"56b9fa29-67df-41f4-85ea-4792f5c8cc73","Type":"ContainerDied","Data":"2f5bdf37de50d37d015dee9c53e4bdf2132e062435026cdc1d3ad57fff259e88"} May 29 00:54:19.364126 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.364071 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" event={"ID":"56b9fa29-67df-41f4-85ea-4792f5c8cc73","Type":"ContainerStarted","Data":"340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e"} May 29 00:54:19.364126 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.364085 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" event={"ID":"4d7152e7-8a49-4b9c-8ca3-405ee49a4642","Type":"ContainerDied","Data":"8313ad75dd2b18fea295fd3c63598eb54151b5e4d2762eac42f9d36c1fcbc7d6"} May 29 00:54:19.364126 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.364098 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" event={"ID":"4d7152e7-8a49-4b9c-8ca3-405ee49a4642","Type":"ContainerStarted","Data":"bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950"} May 29 00:54:19.364267 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.364252 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.369308 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.369287 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d"] May 29 00:54:19.398467 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.398440 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5sfg\" (UniqueName: \"kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.398556 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.398487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.398623 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.398614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.499295 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.499269 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.499677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.499348 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5sfg\" (UniqueName: \"kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.499677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.499384 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.499677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.499584 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.499855 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.499739 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.508050 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.508029 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5sfg\" (UniqueName: \"kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.704795 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.704728 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:19.824085 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:19.824060 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d"] May 29 00:54:19.825721 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:19.825694 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce1f002_3f70_4fa8_b54b_aa7491d01545.slice/crio-5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b WatchSource:0}: Error finding container 5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b: Status 404 returned error can't find the container with id 5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b May 29 00:54:20.368684 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.368656 2570 generic.go:358] "Generic (PLEG): container finished" podID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerID="fc26226945303365d1589d0164eda1d9ef19d4361cb821558396d0a664ae6494" exitCode=0 May 29 00:54:20.368800 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.368732 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" event={"ID":"79d2c63b-544a-4250-bf25-49a75adfdafb","Type":"ContainerDied","Data":"fc26226945303365d1589d0164eda1d9ef19d4361cb821558396d0a664ae6494"} May 29 00:54:20.369886 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.369867 2570 generic.go:358] "Generic (PLEG): container finished" podID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerID="6850e5aa683995cdbaf3827f5205e9b75566e0de1fd2e70bdb3f7bacbedefad5" exitCode=0 May 29 00:54:20.369973 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.369938 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" event={"ID":"3ce1f002-3f70-4fa8-b54b-aa7491d01545","Type":"ContainerDied","Data":"6850e5aa683995cdbaf3827f5205e9b75566e0de1fd2e70bdb3f7bacbedefad5"} May 29 00:54:20.369973 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.369962 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" event={"ID":"3ce1f002-3f70-4fa8-b54b-aa7491d01545","Type":"ContainerStarted","Data":"5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b"} May 29 00:54:20.371510 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.371490 2570 generic.go:358] "Generic (PLEG): container finished" podID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerID="cc0bf58e07c0dfa35a1a9d052d1f8254d8a322f3d576142dfa8df62346b24c88" exitCode=0 May 29 00:54:20.371599 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.371562 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" event={"ID":"56b9fa29-67df-41f4-85ea-4792f5c8cc73","Type":"ContainerDied","Data":"cc0bf58e07c0dfa35a1a9d052d1f8254d8a322f3d576142dfa8df62346b24c88"} May 29 00:54:20.373100 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.373079 2570 generic.go:358] "Generic (PLEG): container finished" podID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerID="13499ed3cc61351892f7324c2316fbd5239f791c775215e1b5187a2f235d0427" exitCode=0 May 29 00:54:20.373183 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:20.373165 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" event={"ID":"4d7152e7-8a49-4b9c-8ca3-405ee49a4642","Type":"ContainerDied","Data":"13499ed3cc61351892f7324c2316fbd5239f791c775215e1b5187a2f235d0427"} May 29 00:54:21.379402 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.379366 2570 generic.go:358] "Generic (PLEG): container finished" podID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerID="b66ceb07770174096ff6565912ec5142b63fd8216354b28e3db2967febdf8836" exitCode=0 May 29 00:54:21.379767 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.379437 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" event={"ID":"56b9fa29-67df-41f4-85ea-4792f5c8cc73","Type":"ContainerDied","Data":"b66ceb07770174096ff6565912ec5142b63fd8216354b28e3db2967febdf8836"} May 29 00:54:21.381323 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.381295 2570 generic.go:358] "Generic (PLEG): container finished" podID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerID="c4e46fbc234d4052a912a5a644b683f94ec239a487cf45a3b5fb8e96f715c6ff" exitCode=0 May 29 00:54:21.381440 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.381380 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" event={"ID":"4d7152e7-8a49-4b9c-8ca3-405ee49a4642","Type":"ContainerDied","Data":"c4e46fbc234d4052a912a5a644b683f94ec239a487cf45a3b5fb8e96f715c6ff"} May 29 00:54:21.383013 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.382990 2570 generic.go:358] "Generic (PLEG): container finished" podID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerID="87a8e449c76a5baaad9736c7c310155988fc860b5ef56fc6ebc8415e0fb089f6" exitCode=0 May 29 00:54:21.383168 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.383069 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" event={"ID":"3ce1f002-3f70-4fa8-b54b-aa7491d01545","Type":"ContainerDied","Data":"87a8e449c76a5baaad9736c7c310155988fc860b5ef56fc6ebc8415e0fb089f6"} May 29 00:54:21.567013 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.566993 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:21.616726 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.616702 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-456xt\" (UniqueName: \"kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt\") pod \"79d2c63b-544a-4250-bf25-49a75adfdafb\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " May 29 00:54:21.616839 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.616813 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util\") pod \"79d2c63b-544a-4250-bf25-49a75adfdafb\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " May 29 00:54:21.616910 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.616846 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle\") pod \"79d2c63b-544a-4250-bf25-49a75adfdafb\" (UID: \"79d2c63b-544a-4250-bf25-49a75adfdafb\") " May 29 00:54:21.617378 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.617352 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle" (OuterVolumeSpecName: "bundle") pod "79d2c63b-544a-4250-bf25-49a75adfdafb" (UID: "79d2c63b-544a-4250-bf25-49a75adfdafb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:21.618489 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.618473 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt" (OuterVolumeSpecName: "kube-api-access-456xt") pod "79d2c63b-544a-4250-bf25-49a75adfdafb" (UID: "79d2c63b-544a-4250-bf25-49a75adfdafb"). InnerVolumeSpecName "kube-api-access-456xt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:54:21.621914 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.621895 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util" (OuterVolumeSpecName: "util") pod "79d2c63b-544a-4250-bf25-49a75adfdafb" (UID: "79d2c63b-544a-4250-bf25-49a75adfdafb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:21.718499 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.718098 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:21.718499 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.718134 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79d2c63b-544a-4250-bf25-49a75adfdafb-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:21.718499 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:21.718148 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-456xt\" (UniqueName: \"kubernetes.io/projected/79d2c63b-544a-4250-bf25-49a75adfdafb-kube-api-access-456xt\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.388134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.388061 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" event={"ID":"79d2c63b-544a-4250-bf25-49a75adfdafb","Type":"ContainerDied","Data":"ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52"} May 29 00:54:22.388134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.388109 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffb6dea1f1511e009a03a850a2ab0fa0243ec685fdcd2cc34bba4d6842190c52" May 29 00:54:22.388134 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.388108 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9" May 29 00:54:22.390419 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.390393 2570 generic.go:358] "Generic (PLEG): container finished" podID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerID="f1d13a4f94e094c3becba2fceaa8c6bf102f30437e4fae379a83f053718b4c85" exitCode=0 May 29 00:54:22.390513 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.390430 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" event={"ID":"3ce1f002-3f70-4fa8-b54b-aa7491d01545","Type":"ContainerDied","Data":"f1d13a4f94e094c3becba2fceaa8c6bf102f30437e4fae379a83f053718b4c85"} May 29 00:54:22.513594 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.513567 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:22.535432 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.535410 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:22.624633 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624610 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle\") pod \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " May 29 00:54:22.624738 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624648 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xztt\" (UniqueName: \"kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt\") pod \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " May 29 00:54:22.624738 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624684 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbml\" (UniqueName: \"kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml\") pod \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " May 29 00:54:22.624870 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624756 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util\") pod \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " May 29 00:54:22.624870 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624816 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util\") pod \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\" (UID: \"4d7152e7-8a49-4b9c-8ca3-405ee49a4642\") " May 29 00:54:22.624870 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.624839 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle\") pod \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\" (UID: \"56b9fa29-67df-41f4-85ea-4792f5c8cc73\") " May 29 00:54:22.625231 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.625203 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle" (OuterVolumeSpecName: "bundle") pod "4d7152e7-8a49-4b9c-8ca3-405ee49a4642" (UID: "4d7152e7-8a49-4b9c-8ca3-405ee49a4642"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:22.625396 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.625365 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle" (OuterVolumeSpecName: "bundle") pod "56b9fa29-67df-41f4-85ea-4792f5c8cc73" (UID: "56b9fa29-67df-41f4-85ea-4792f5c8cc73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:22.626711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.626691 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt" (OuterVolumeSpecName: "kube-api-access-4xztt") pod "4d7152e7-8a49-4b9c-8ca3-405ee49a4642" (UID: "4d7152e7-8a49-4b9c-8ca3-405ee49a4642"). InnerVolumeSpecName "kube-api-access-4xztt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:54:22.626836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.626725 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml" (OuterVolumeSpecName: "kube-api-access-mwbml") pod "56b9fa29-67df-41f4-85ea-4792f5c8cc73" (UID: "56b9fa29-67df-41f4-85ea-4792f5c8cc73"). InnerVolumeSpecName "kube-api-access-mwbml". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:54:22.630245 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.630214 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util" (OuterVolumeSpecName: "util") pod "4d7152e7-8a49-4b9c-8ca3-405ee49a4642" (UID: "4d7152e7-8a49-4b9c-8ca3-405ee49a4642"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:22.632906 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.632869 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util" (OuterVolumeSpecName: "util") pod "56b9fa29-67df-41f4-85ea-4792f5c8cc73" (UID: "56b9fa29-67df-41f4-85ea-4792f5c8cc73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:22.726073 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726053 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.726140 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726074 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.726140 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726085 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.726140 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726093 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xztt\" (UniqueName: \"kubernetes.io/projected/4d7152e7-8a49-4b9c-8ca3-405ee49a4642-kube-api-access-4xztt\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.726140 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726104 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbml\" (UniqueName: \"kubernetes.io/projected/56b9fa29-67df-41f4-85ea-4792f5c8cc73-kube-api-access-mwbml\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:22.726140 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:22.726112 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b9fa29-67df-41f4-85ea-4792f5c8cc73-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:23.396273 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.396239 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" event={"ID":"56b9fa29-67df-41f4-85ea-4792f5c8cc73","Type":"ContainerDied","Data":"340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e"} May 29 00:54:23.396273 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.396268 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj" May 29 00:54:23.396744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.396274 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="340b184d7c8fbd4923a66b7d799755b69e1f1fe0bd5adc47e3601b4864d5141e" May 29 00:54:23.398265 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.398244 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" May 29 00:54:23.398377 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.398263 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg" event={"ID":"4d7152e7-8a49-4b9c-8ca3-405ee49a4642","Type":"ContainerDied","Data":"bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950"} May 29 00:54:23.398377 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.398290 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd17649b61d307c875235cce6efd7e5f7bfac41ef8d4b98a690ce0179070b950" May 29 00:54:23.522530 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.522511 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:23.633420 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.633398 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util\") pod \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " May 29 00:54:23.633526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.633428 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle\") pod \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " May 29 00:54:23.633526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.633453 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5sfg\" (UniqueName: \"kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg\") pod \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\" (UID: \"3ce1f002-3f70-4fa8-b54b-aa7491d01545\") " May 29 00:54:23.633981 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.633957 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle" (OuterVolumeSpecName: "bundle") pod "3ce1f002-3f70-4fa8-b54b-aa7491d01545" (UID: "3ce1f002-3f70-4fa8-b54b-aa7491d01545"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:23.635335 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.635312 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg" (OuterVolumeSpecName: "kube-api-access-h5sfg") pod "3ce1f002-3f70-4fa8-b54b-aa7491d01545" (UID: "3ce1f002-3f70-4fa8-b54b-aa7491d01545"). InnerVolumeSpecName "kube-api-access-h5sfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:54:23.638690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.638617 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util" (OuterVolumeSpecName: "util") pod "3ce1f002-3f70-4fa8-b54b-aa7491d01545" (UID: "3ce1f002-3f70-4fa8-b54b-aa7491d01545"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:54:23.734385 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.734365 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:23.734385 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.734386 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ce1f002-3f70-4fa8-b54b-aa7491d01545-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:23.734506 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:23.734396 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5sfg\" (UniqueName: \"kubernetes.io/projected/3ce1f002-3f70-4fa8-b54b-aa7491d01545-kube-api-access-h5sfg\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:54:24.404403 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:24.404351 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" May 29 00:54:24.404403 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:24.404364 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d" event={"ID":"3ce1f002-3f70-4fa8-b54b-aa7491d01545","Type":"ContainerDied","Data":"5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b"} May 29 00:54:24.404403 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:24.404397 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ccf6cf1e90f465104825c9d30da4987026a2fedc6e5e1773dc0b36ff13e1a4b" May 29 00:54:34.390829 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.390789 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf"] May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391024 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391036 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391055 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391060 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391066 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391071 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391084 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391089 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391095 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391101 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391110 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391115 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391122 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391127 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="pull" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391132 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391137 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391144 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391150 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391157 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391165 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391174 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391181 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391188 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391194 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="util" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391232 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d7152e7-8a49-4b9c-8ca3-405ee49a4642" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391239 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ce1f002-3f70-4fa8-b54b-aa7491d01545" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391248 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="56b9fa29-67df-41f4-85ea-4792f5c8cc73" containerName="extract" May 29 00:54:34.391297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.391255 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="79d2c63b-544a-4250-bf25-49a75adfdafb" containerName="extract" May 29 00:54:34.394144 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.394122 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:34.396642 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.396613 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6cv4z\"" May 29 00:54:34.407392 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.407363 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf"] May 29 00:54:34.504822 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.504799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbdl\" (UniqueName: \"kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl\") pod \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" (UID: \"7f2eb5e8-081e-4421-851d-d611e3312653\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:34.605267 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.605234 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbdl\" (UniqueName: \"kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl\") pod \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" (UID: \"7f2eb5e8-081e-4421-851d-d611e3312653\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:34.622955 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.622940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbdl\" (UniqueName: \"kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl\") pod \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" (UID: \"7f2eb5e8-081e-4421-851d-d611e3312653\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:34.704123 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.704075 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:34.823045 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:34.823020 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf"] May 29 00:54:34.824011 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:34.823989 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2eb5e8_081e_4421_851d_d611e3312653.slice/crio-d90ae32332eac3416c863470f016a6e764986ba4932db0e04edb97813907f1b5 WatchSource:0}: Error finding container d90ae32332eac3416c863470f016a6e764986ba4932db0e04edb97813907f1b5: Status 404 returned error can't find the container with id d90ae32332eac3416c863470f016a6e764986ba4932db0e04edb97813907f1b5 May 29 00:54:35.443236 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:35.443198 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" event={"ID":"7f2eb5e8-081e-4421-851d-d611e3312653","Type":"ContainerStarted","Data":"d90ae32332eac3416c863470f016a6e764986ba4932db0e04edb97813907f1b5"} May 29 00:54:37.451196 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:37.451120 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" event={"ID":"7f2eb5e8-081e-4421-851d-d611e3312653","Type":"ContainerStarted","Data":"2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9"} May 29 00:54:37.451485 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:37.451264 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:37.469930 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:37.469888 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" podStartSLOduration=1.271068571 podStartE2EDuration="3.469877614s" podCreationTimestamp="2026-05-29 00:54:34 +0000 UTC" firstStartedPulling="2026-05-29 00:54:34.825689546 +0000 UTC m=+439.436760856" lastFinishedPulling="2026-05-29 00:54:37.02449859 +0000 UTC m=+441.635569899" observedRunningTime="2026-05-29 00:54:37.469075594 +0000 UTC m=+442.080146926" watchObservedRunningTime="2026-05-29 00:54:37.469877614 +0000 UTC m=+442.080948948" May 29 00:54:45.175145 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.175106 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd"] May 29 00:54:45.179833 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.179809 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:45.182390 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.182365 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 29 00:54:45.182501 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.182422 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zdvjh\"" May 29 00:54:45.187303 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.187264 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd"] May 29 00:54:45.280309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.280280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7vhj\" (UniqueName: \"kubernetes.io/projected/0c6b90fa-0786-4da3-965d-4695765cb529-kube-api-access-q7vhj\") pod \"dns-operator-controller-manager-648d5c98bc-6gdwd\" (UID: \"0c6b90fa-0786-4da3-965d-4695765cb529\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:45.381565 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.381532 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7vhj\" (UniqueName: \"kubernetes.io/projected/0c6b90fa-0786-4da3-965d-4695765cb529-kube-api-access-q7vhj\") pod \"dns-operator-controller-manager-648d5c98bc-6gdwd\" (UID: \"0c6b90fa-0786-4da3-965d-4695765cb529\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:45.392413 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.392384 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7vhj\" (UniqueName: \"kubernetes.io/projected/0c6b90fa-0786-4da3-965d-4695765cb529-kube-api-access-q7vhj\") pod \"dns-operator-controller-manager-648d5c98bc-6gdwd\" (UID: \"0c6b90fa-0786-4da3-965d-4695765cb529\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:45.496882 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.496854 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:45.619438 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:45.619414 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd"] May 29 00:54:45.621160 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:54:45.621134 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6b90fa_0786_4da3_965d_4695765cb529.slice/crio-851add16413b682981d3a50c0e56b1a0436c843a847a13a823e581bc7c42e588 WatchSource:0}: Error finding container 851add16413b682981d3a50c0e56b1a0436c843a847a13a823e581bc7c42e588: Status 404 returned error can't find the container with id 851add16413b682981d3a50c0e56b1a0436c843a847a13a823e581bc7c42e588 May 29 00:54:46.482652 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:46.482615 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" event={"ID":"0c6b90fa-0786-4da3-965d-4695765cb529","Type":"ContainerStarted","Data":"851add16413b682981d3a50c0e56b1a0436c843a847a13a823e581bc7c42e588"} May 29 00:54:48.397815 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.397765 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6"] May 29 00:54:48.400873 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.400856 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.404996 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.404970 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 29 00:54:48.405099 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.405052 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhbdl\"" May 29 00:54:48.405309 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.405293 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 29 00:54:48.411495 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.411469 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6"] May 29 00:54:48.457106 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.457086 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:54:48.490834 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.490799 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" event={"ID":"0c6b90fa-0786-4da3-965d-4695765cb529","Type":"ContainerStarted","Data":"7b15051d38e6f2bf78a1b13fc2264608fcd7d76d3e020ac5fb19e84512f670cf"} May 29 00:54:48.490950 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.490889 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:48.505699 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.505676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q76g\" (UniqueName: \"kubernetes.io/projected/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-kube-api-access-2q76g\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.505813 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.505744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.505862 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.505814 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.516565 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.516521 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" podStartSLOduration=1.389298815 podStartE2EDuration="3.516511624s" podCreationTimestamp="2026-05-29 00:54:45 +0000 UTC" firstStartedPulling="2026-05-29 00:54:45.623449413 +0000 UTC m=+450.234520726" lastFinishedPulling="2026-05-29 00:54:47.750662226 +0000 UTC m=+452.361733535" observedRunningTime="2026-05-29 00:54:48.514200496 +0000 UTC m=+453.125271826" watchObservedRunningTime="2026-05-29 00:54:48.516511624 +0000 UTC m=+453.127582954" May 29 00:54:48.606650 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.606627 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q76g\" (UniqueName: \"kubernetes.io/projected/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-kube-api-access-2q76g\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.606739 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.606658 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.606739 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.606715 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.607367 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.607351 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.608908 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.608888 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.614606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.614589 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q76g\" (UniqueName: \"kubernetes.io/projected/fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb-kube-api-access-2q76g\") pod \"kuadrant-console-plugin-6cb54b5c86-4pjf6\" (UID: \"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.709894 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.709839 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" May 29 00:54:48.836813 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:48.836163 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6"] May 29 00:54:49.496454 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:49.496419 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" event={"ID":"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb","Type":"ContainerStarted","Data":"f8f857afca35c3e4c15a5fb3441082852109ed09dde0c805f8f7866414526477"} May 29 00:54:58.589419 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.589382 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8"] May 29 00:54:58.608543 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.608511 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8"] May 29 00:54:58.608690 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.608565 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.611465 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.611444 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f6qxk\"" May 29 00:54:58.687563 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.687536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.687694 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.687597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjq7d\" (UniqueName: \"kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.788858 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.788828 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjq7d\" (UniqueName: \"kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.788966 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.788911 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.789234 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.789217 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.797225 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.797195 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjq7d\" (UniqueName: \"kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:58.920242 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:58.920179 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:54:59.339464 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.339434 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8"] May 29 00:54:59.347448 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.347421 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8"] May 29 00:54:59.360551 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.360409 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf"] May 29 00:54:59.361217 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.360886 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" containerName="manager" containerID="cri-o://2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9" gracePeriod=2 May 29 00:54:59.364339 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.364310 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:54:59.364487 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.364472 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:54:59.378147 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.378091 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf"] May 29 00:54:59.378147 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.378134 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:54:59.378296 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.378287 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.381000 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.380972 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:54:59.384227 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.384185 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9"] May 29 00:54:59.384507 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.384492 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" containerName="manager" May 29 00:54:59.384598 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.384511 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" containerName="manager" May 29 00:54:59.384598 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.384576 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" containerName="manager" May 29 00:54:59.387725 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.387706 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:54:59.396671 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.396652 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9"] May 29 00:54:59.427861 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.427829 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:54:59.493924 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.493892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6v56\" (UniqueName: \"kubernetes.io/projected/90bdbfca-8138-47b9-8e78-7beb4451edcf-kube-api-access-r6v56\") pod \"limitador-operator-controller-manager-85c4996f8c-dknq9\" (UID: \"90bdbfca-8138-47b9-8e78-7beb4451edcf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:54:59.494058 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.493941 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7n44\" (UniqueName: \"kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.494058 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.494023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.498527 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.498504 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6gdwd" May 29 00:54:59.501004 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.500975 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:54:59.595331 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.595262 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.595711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.595349 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v56\" (UniqueName: \"kubernetes.io/projected/90bdbfca-8138-47b9-8e78-7beb4451edcf-kube-api-access-r6v56\") pod \"limitador-operator-controller-manager-85c4996f8c-dknq9\" (UID: \"90bdbfca-8138-47b9-8e78-7beb4451edcf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:54:59.595711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.595435 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7n44\" (UniqueName: \"kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.595711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.595675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.613378 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.613350 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7n44\" (UniqueName: \"kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.613469 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.613378 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6v56\" (UniqueName: \"kubernetes.io/projected/90bdbfca-8138-47b9-8e78-7beb4451edcf-kube-api-access-r6v56\") pod \"limitador-operator-controller-manager-85c4996f8c-dknq9\" (UID: \"90bdbfca-8138-47b9-8e78-7beb4451edcf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:54:59.729384 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.729348 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:54:59.735030 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:54:59.735009 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:55:09.864844 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.864820 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:55:09.867425 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.867395 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:09.875480 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.875458 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:55:09.876431 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:09.876405 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e407e8_15da_4bc7_bb4f_2d3ceceb5e7c.slice/crio-ef14c0b3d3b8c19460a5bff9ea7fa406c3988d1587c6e60dc77b8c218e842739 WatchSource:0}: Error finding container ef14c0b3d3b8c19460a5bff9ea7fa406c3988d1587c6e60dc77b8c218e842739: Status 404 returned error can't find the container with id ef14c0b3d3b8c19460a5bff9ea7fa406c3988d1587c6e60dc77b8c218e842739 May 29 00:55:09.895071 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.895046 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9"] May 29 00:55:09.895870 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:09.895840 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bdbfca_8138_47b9_8e78_7beb4451edcf.slice/crio-bd226e33f5f09c95c7c2d1a9695ea76380ce5ff03c2c1ba08b353c3ca0199eda WatchSource:0}: Error finding container bd226e33f5f09c95c7c2d1a9695ea76380ce5ff03c2c1ba08b353c3ca0199eda: Status 404 returned error can't find the container with id bd226e33f5f09c95c7c2d1a9695ea76380ce5ff03c2c1ba08b353c3ca0199eda May 29 00:55:09.983441 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.983419 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tbdl\" (UniqueName: \"kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl\") pod \"7f2eb5e8-081e-4421-851d-d611e3312653\" (UID: \"7f2eb5e8-081e-4421-851d-d611e3312653\") " May 29 00:55:09.985060 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:09.985037 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl" (OuterVolumeSpecName: "kube-api-access-9tbdl") pod "7f2eb5e8-081e-4421-851d-d611e3312653" (UID: "7f2eb5e8-081e-4421-851d-d611e3312653"). InnerVolumeSpecName "kube-api-access-9tbdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:55:10.084153 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.084128 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tbdl\" (UniqueName: \"kubernetes.io/projected/7f2eb5e8-081e-4421-851d-d611e3312653-kube-api-access-9tbdl\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:10.090575 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.090548 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" path="/var/lib/kubelet/pods/7f2eb5e8-081e-4421-851d-d611e3312653/volumes" May 29 00:55:10.578504 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.578478 2570 generic.go:358] "Generic (PLEG): container finished" podID="7f2eb5e8-081e-4421-851d-d611e3312653" containerID="2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9" exitCode=0 May 29 00:55:10.578649 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.578532 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" May 29 00:55:10.578649 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.578560 2570 scope.go:117] "RemoveContainer" containerID="2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9" May 29 00:55:10.580996 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.580500 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" event={"ID":"90bdbfca-8138-47b9-8e78-7beb4451edcf","Type":"ContainerStarted","Data":"79eaabcebcfc62856ca549ee6a309256245c694e5b33675f2890db2c2f9f125b"} May 29 00:55:10.580996 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.580531 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" event={"ID":"90bdbfca-8138-47b9-8e78-7beb4451edcf","Type":"ContainerStarted","Data":"bd226e33f5f09c95c7c2d1a9695ea76380ce5ff03c2c1ba08b353c3ca0199eda"} May 29 00:55:10.580996 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.580628 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:55:10.581308 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.581267 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:10.582353 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.582332 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" event={"ID":"fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb","Type":"ContainerStarted","Data":"35ed23bd636a2c0041ed4791f43df4de903e344c9d532d3f97fbc443ed5c2b2e"} May 29 00:55:10.583561 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.583538 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" event={"ID":"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c","Type":"ContainerStarted","Data":"ef14c0b3d3b8c19460a5bff9ea7fa406c3988d1587c6e60dc77b8c218e842739"} May 29 00:55:10.588364 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.588343 2570 scope.go:117] "RemoveContainer" containerID="2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9" May 29 00:55:10.588606 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:55:10.588590 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9\": container with ID starting with 2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9 not found: ID does not exist" containerID="2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9" May 29 00:55:10.588661 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.588613 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9"} err="failed to get container status \"2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9\": rpc error: code = NotFound desc = could not find container \"2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9\": container with ID starting with 2d7fc6b847fa71744f66d317799ff0ca172bb4b5f7c8f15f8c3228ffc93dbda9 not found: ID does not exist" May 29 00:55:10.599057 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.599012 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" podStartSLOduration=11.59899866 podStartE2EDuration="11.59899866s" podCreationTimestamp="2026-05-29 00:54:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:55:10.597894247 +0000 UTC m=+475.208965579" watchObservedRunningTime="2026-05-29 00:55:10.59899866 +0000 UTC m=+475.210069993" May 29 00:55:10.599783 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.599742 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:10.616233 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.616211 2570 status_manager.go:895] "Failed to get status for pod" podUID="7f2eb5e8-081e-4421-851d-d611e3312653" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dcjrf" err="pods \"limitador-operator-controller-manager-85c4996f8c-dcjrf\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:10.617096 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:10.617059 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4pjf6" podStartSLOduration=1.655452653 podStartE2EDuration="22.617049112s" podCreationTimestamp="2026-05-29 00:54:48 +0000 UTC" firstStartedPulling="2026-05-29 00:54:48.839408188 +0000 UTC m=+453.450479504" lastFinishedPulling="2026-05-29 00:55:09.801004653 +0000 UTC m=+474.412075963" observedRunningTime="2026-05-29 00:55:10.614269836 +0000 UTC m=+475.225341167" watchObservedRunningTime="2026-05-29 00:55:10.617049112 +0000 UTC m=+475.228120442" May 29 00:55:12.247295 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:12.247254 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c93ada9_2c6e_4102_b085_2e853d8f57ff.slice/crio-3645fd4464189f7b0f3d07791c033d19166546eb27d6f3c11f680e8e83b70f1e WatchSource:0}: Error finding container 3645fd4464189f7b0f3d07791c033d19166546eb27d6f3c11f680e8e83b70f1e: Status 404 returned error can't find the container with id 3645fd4464189f7b0f3d07791c033d19166546eb27d6f3c11f680e8e83b70f1e May 29 00:55:15.608155 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.608119 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" event={"ID":"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c","Type":"ContainerStarted","Data":"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5"} May 29 00:55:15.608585 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.608191 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:55:15.609536 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.609513 2570 generic.go:358] "Generic (PLEG): container finished" podID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" containerID="6e7d5850600d37102edabf073111a4839a97f102afe927cf602d169dd75133b6" exitCode=1 May 29 00:55:15.626494 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.626450 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" podStartSLOduration=11.290410665 podStartE2EDuration="16.626438243s" podCreationTimestamp="2026-05-29 00:54:59 +0000 UTC" firstStartedPulling="2026-05-29 00:55:09.878672327 +0000 UTC m=+474.489743636" lastFinishedPulling="2026-05-29 00:55:15.21469989 +0000 UTC m=+479.825771214" observedRunningTime="2026-05-29 00:55:15.625515185 +0000 UTC m=+480.236586517" watchObservedRunningTime="2026-05-29 00:55:15.626438243 +0000 UTC m=+480.237509574" May 29 00:55:15.627430 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.627393 2570 status_manager.go:895] "Failed to get status for pod" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:15.637767 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.637745 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:55:15.639669 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.639649 2570 status_manager.go:895] "Failed to get status for pod" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:15.827088 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.827054 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjq7d\" (UniqueName: \"kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d\") pod \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " May 29 00:55:15.827212 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.827134 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume\") pod \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\" (UID: \"9c93ada9-2c6e-4102-b085-2e853d8f57ff\") " May 29 00:55:15.827345 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.827323 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c93ada9-2c6e-4102-b085-2e853d8f57ff" (UID: "9c93ada9-2c6e-4102-b085-2e853d8f57ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:55:15.827416 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.827400 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c93ada9-2c6e-4102-b085-2e853d8f57ff-extensions-socket-volume\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:15.828974 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.828955 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d" (OuterVolumeSpecName: "kube-api-access-rjq7d") pod "9c93ada9-2c6e-4102-b085-2e853d8f57ff" (UID: "9c93ada9-2c6e-4102-b085-2e853d8f57ff"). InnerVolumeSpecName "kube-api-access-rjq7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:55:15.928458 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:15.928439 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjq7d\" (UniqueName: \"kubernetes.io/projected/9c93ada9-2c6e-4102-b085-2e853d8f57ff-kube-api-access-rjq7d\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:16.089200 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.089150 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" path="/var/lib/kubelet/pods/9c93ada9-2c6e-4102-b085-2e853d8f57ff/volumes" May 29 00:55:16.089866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.089846 2570 status_manager.go:895] "Failed to get status for pod" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:16.618765 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.618732 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" May 29 00:55:16.619190 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.618769 2570 scope.go:117] "RemoveContainer" containerID="6e7d5850600d37102edabf073111a4839a97f102afe927cf602d169dd75133b6" May 29 00:55:16.621125 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.621095 2570 status_manager.go:895] "Failed to get status for pod" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:16.623083 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:16.623049 2570 status_manager.go:895] "Failed to get status for pod" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-nx4z8\" is forbidden: User \"system:node:ip-10-0-140-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-228.ec2.internal' and this object" May 29 00:55:21.591264 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:21.591230 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dknq9" May 29 00:55:26.621344 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:26.621312 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:55:38.832045 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:38.832009 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:55:38.832484 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:38.832226 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" podUID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" containerName="manager" containerID="cri-o://eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5" gracePeriod=10 May 29 00:55:39.078323 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.078301 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:55:39.196337 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.196274 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume\") pod \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " May 29 00:55:39.196337 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.196314 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7n44\" (UniqueName: \"kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44\") pod \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\" (UID: \"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c\") " May 29 00:55:39.196605 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.196583 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" (UID: "47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:55:39.198262 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.198237 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44" (OuterVolumeSpecName: "kube-api-access-c7n44") pod "47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" (UID: "47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c"). InnerVolumeSpecName "kube-api-access-c7n44". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:55:39.297293 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.297265 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-extensions-socket-volume\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:39.297293 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.297289 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7n44\" (UniqueName: \"kubernetes.io/projected/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c-kube-api-access-c7n44\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:39.703606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.703573 2570 generic.go:358] "Generic (PLEG): container finished" podID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" containerID="eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5" exitCode=0 May 29 00:55:39.703757 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.703631 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" May 29 00:55:39.703757 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.703644 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" event={"ID":"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c","Type":"ContainerDied","Data":"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5"} May 29 00:55:39.703757 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.703683 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t" event={"ID":"47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c","Type":"ContainerDied","Data":"ef14c0b3d3b8c19460a5bff9ea7fa406c3988d1587c6e60dc77b8c218e842739"} May 29 00:55:39.703757 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.703699 2570 scope.go:117] "RemoveContainer" containerID="eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5" May 29 00:55:39.712016 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.711999 2570 scope.go:117] "RemoveContainer" containerID="eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5" May 29 00:55:39.712251 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:55:39.712237 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5\": container with ID starting with eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5 not found: ID does not exist" containerID="eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5" May 29 00:55:39.712341 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.712259 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5"} err="failed to get container status \"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5\": rpc error: code = NotFound desc = could not find container \"eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5\": container with ID starting with eb08e243eb0e4a8386d1a9f87c9c02550b8f17c22cd1b208e60af743ccd862f5 not found: ID does not exist" May 29 00:55:39.736521 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.736497 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:55:39.750188 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:39.750167 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jsz7t"] May 29 00:55:40.089497 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:40.089471 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" path="/var/lib/kubelet/pods/47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c/volumes" May 29 00:55:42.894797 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.894743 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb"] May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895032 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" containerName="manager" May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895051 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" containerName="manager" May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895078 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" containerName="manager" May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895084 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" containerName="manager" May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895129 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="47e407e8-15da-4bc7-bb4f-2d3ceceb5e7c" containerName="manager" May 29 00:55:42.895221 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.895139 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c93ada9-2c6e-4102-b085-2e853d8f57ff" containerName="manager" May 29 00:55:42.923599 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.923573 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb"] May 29 00:55:42.923759 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.923688 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:42.926417 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:42.926393 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vmn8x\"" May 29 00:55:43.026545 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026511 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026715 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026552 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd6hn\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-kube-api-access-dd6hn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026715 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb02f5e-38be-4935-9531-8897868fb67c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026715 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026687 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026862 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026757 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026862 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026811 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026862 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026862 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.026990 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.026878 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb02f5e-38be-4935-9531-8897868fb67c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127429 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127389 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127429 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127433 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127627 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127454 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127627 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127480 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127627 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127508 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb02f5e-38be-4935-9531-8897868fb67c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127627 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127553 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127627 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127588 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd6hn\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-kube-api-access-dd6hn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127905 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127652 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb02f5e-38be-4935-9531-8897868fb67c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127905 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127823 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.127905 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127892 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.128062 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.127993 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.128117 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.128004 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.128247 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.128227 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.128300 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.128265 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb02f5e-38be-4935-9531-8897868fb67c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.129569 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.129551 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb02f5e-38be-4935-9531-8897868fb67c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.130026 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.130010 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb02f5e-38be-4935-9531-8897868fb67c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.135768 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.135738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.135962 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.135944 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd6hn\" (UniqueName: \"kubernetes.io/projected/3eb02f5e-38be-4935-9531-8897868fb67c-kube-api-access-dd6hn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-r7cnb\" (UID: \"3eb02f5e-38be-4935-9531-8897868fb67c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.234628 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.234605 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:43.361354 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.361312 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb"] May 29 00:55:43.362696 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.362653 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:55:43.362828 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.362797 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:55:43.363074 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.362886 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 29 00:55:43.718807 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.718696 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" event={"ID":"3eb02f5e-38be-4935-9531-8897868fb67c","Type":"ContainerStarted","Data":"64c4542f1444a68b5cd35873ceb49a9af72fdb1e9c0d6553550208a7080a2c8e"} May 29 00:55:43.718807 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.718744 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" event={"ID":"3eb02f5e-38be-4935-9531-8897868fb67c","Type":"ContainerStarted","Data":"bc81684b5b44e88db7c1c2c2ed1b5c98cdee44858d7a6611a55019dc63bd40f8"} May 29 00:55:43.739441 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:43.739398 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" podStartSLOduration=1.73938368 podStartE2EDuration="1.73938368s" podCreationTimestamp="2026-05-29 00:55:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 00:55:43.737355104 +0000 UTC m=+508.348426435" watchObservedRunningTime="2026-05-29 00:55:43.73938368 +0000 UTC m=+508.350455011" May 29 00:55:44.235271 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:44.235242 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:44.239653 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:44.239634 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:44.722210 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:44.722126 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:44.723174 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:44.723156 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-r7cnb" May 29 00:55:47.072587 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.072559 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:55:47.075197 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.075180 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.077358 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.077337 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 29 00:55:47.085449 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.085430 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:55:47.158638 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.158610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9tts\" (UniqueName: \"kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.158803 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.158713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.174034 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.174006 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:55:47.259969 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.259941 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.260062 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.259982 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9tts\" (UniqueName: \"kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.260501 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.260484 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.267511 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.267484 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9tts\" (UniqueName: \"kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts\") pod \"limitador-limitador-7d549b5b-n2wbs\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.385743 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.385684 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:47.507411 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.507388 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:55:47.509558 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:47.509533 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12d7801_3edf_44de_a3a1_bb9ee989b635.slice/crio-4570eb339bd2cad3b7380c3771912665e74f1b17e5d46594289f8e12726e16c1 WatchSource:0}: Error finding container 4570eb339bd2cad3b7380c3771912665e74f1b17e5d46594289f8e12726e16c1: Status 404 returned error can't find the container with id 4570eb339bd2cad3b7380c3771912665e74f1b17e5d46594289f8e12726e16c1 May 29 00:55:47.739967 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.739931 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" event={"ID":"b12d7801-3edf-44de-a3a1-bb9ee989b635","Type":"ContainerStarted","Data":"4570eb339bd2cad3b7380c3771912665e74f1b17e5d46594289f8e12726e16c1"} May 29 00:55:47.882438 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.882401 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:47.885511 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.885492 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:47.887737 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.887720 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nqq5k\"" May 29 00:55:47.891233 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.891209 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:47.966529 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.966504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp454\" (UniqueName: \"kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454\") pod \"authorino-f99f4b5cd-vvj99\" (UID: \"ff18162a-f65d-47dc-8fe6-496b606c4054\") " pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:47.994191 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.994136 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:55:47.996839 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:47.996824 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:55:48.001251 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.001229 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:55:48.066849 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.066827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rp9m\" (UniqueName: \"kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m\") pod \"authorino-7498df8756-rkff2\" (UID: \"cc9ab10e-868d-459e-9d7c-5d845b58098a\") " pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:55:48.066948 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.066880 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bp454\" (UniqueName: \"kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454\") pod \"authorino-f99f4b5cd-vvj99\" (UID: \"ff18162a-f65d-47dc-8fe6-496b606c4054\") " pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:48.073972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.073952 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp454\" (UniqueName: \"kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454\") pod \"authorino-f99f4b5cd-vvj99\" (UID: \"ff18162a-f65d-47dc-8fe6-496b606c4054\") " pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:48.168075 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.168007 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rp9m\" (UniqueName: \"kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m\") pod \"authorino-7498df8756-rkff2\" (UID: \"cc9ab10e-868d-459e-9d7c-5d845b58098a\") " pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:55:48.175831 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.175811 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rp9m\" (UniqueName: \"kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m\") pod \"authorino-7498df8756-rkff2\" (UID: \"cc9ab10e-868d-459e-9d7c-5d845b58098a\") " pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:55:48.196518 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.196496 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:48.306336 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.305932 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:55:48.376091 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.376040 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:48.377708 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:48.377630 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff18162a_f65d_47dc_8fe6_496b606c4054.slice/crio-78b29fc99120a7bdd1ebe71fa4853c1b68136c2212eded907ad128d5839e9282 WatchSource:0}: Error finding container 78b29fc99120a7bdd1ebe71fa4853c1b68136c2212eded907ad128d5839e9282: Status 404 returned error can't find the container with id 78b29fc99120a7bdd1ebe71fa4853c1b68136c2212eded907ad128d5839e9282 May 29 00:55:48.498859 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.498829 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:55:48.500252 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:55:48.500225 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc9ab10e_868d_459e_9d7c_5d845b58098a.slice/crio-1157bd6890ab0e1a26bdbb1289bb4510475d2bf6a2dfa3ae8b8fe9a7e0f51257 WatchSource:0}: Error finding container 1157bd6890ab0e1a26bdbb1289bb4510475d2bf6a2dfa3ae8b8fe9a7e0f51257: Status 404 returned error can't find the container with id 1157bd6890ab0e1a26bdbb1289bb4510475d2bf6a2dfa3ae8b8fe9a7e0f51257 May 29 00:55:48.745535 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.745501 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rkff2" event={"ID":"cc9ab10e-868d-459e-9d7c-5d845b58098a","Type":"ContainerStarted","Data":"1157bd6890ab0e1a26bdbb1289bb4510475d2bf6a2dfa3ae8b8fe9a7e0f51257"} May 29 00:55:48.746932 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:48.746907 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" event={"ID":"ff18162a-f65d-47dc-8fe6-496b606c4054","Type":"ContainerStarted","Data":"78b29fc99120a7bdd1ebe71fa4853c1b68136c2212eded907ad128d5839e9282"} May 29 00:55:52.774108 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.774071 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" event={"ID":"b12d7801-3edf-44de-a3a1-bb9ee989b635","Type":"ContainerStarted","Data":"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc"} May 29 00:55:52.774544 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.774225 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:55:52.775493 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.775473 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" event={"ID":"ff18162a-f65d-47dc-8fe6-496b606c4054","Type":"ContainerStarted","Data":"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644"} May 29 00:55:52.776660 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.776639 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rkff2" event={"ID":"cc9ab10e-868d-459e-9d7c-5d845b58098a","Type":"ContainerStarted","Data":"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25"} May 29 00:55:52.792531 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.792484 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" podStartSLOduration=0.717373273 podStartE2EDuration="5.792471071s" podCreationTimestamp="2026-05-29 00:55:47 +0000 UTC" firstStartedPulling="2026-05-29 00:55:47.511305956 +0000 UTC m=+512.122377267" lastFinishedPulling="2026-05-29 00:55:52.586403754 +0000 UTC m=+517.197475065" observedRunningTime="2026-05-29 00:55:52.790585195 +0000 UTC m=+517.401656528" watchObservedRunningTime="2026-05-29 00:55:52.792471071 +0000 UTC m=+517.403542404" May 29 00:55:52.807297 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.807251 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" podStartSLOduration=1.598258899 podStartE2EDuration="5.807240116s" podCreationTimestamp="2026-05-29 00:55:47 +0000 UTC" firstStartedPulling="2026-05-29 00:55:48.38046059 +0000 UTC m=+512.991531905" lastFinishedPulling="2026-05-29 00:55:52.589441808 +0000 UTC m=+517.200513122" observedRunningTime="2026-05-29 00:55:52.806140669 +0000 UTC m=+517.417212004" watchObservedRunningTime="2026-05-29 00:55:52.807240116 +0000 UTC m=+517.418311449" May 29 00:55:52.821175 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.821130 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-rkff2" podStartSLOduration=1.725186922 podStartE2EDuration="5.821115231s" podCreationTimestamp="2026-05-29 00:55:47 +0000 UTC" firstStartedPulling="2026-05-29 00:55:48.501909756 +0000 UTC m=+513.112981070" lastFinishedPulling="2026-05-29 00:55:52.597838061 +0000 UTC m=+517.208909379" observedRunningTime="2026-05-29 00:55:52.819089675 +0000 UTC m=+517.430161016" watchObservedRunningTime="2026-05-29 00:55:52.821115231 +0000 UTC m=+517.432186578" May 29 00:55:52.843058 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:52.842965 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:54.784218 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:54.784174 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" podUID="ff18162a-f65d-47dc-8fe6-496b606c4054" containerName="authorino" containerID="cri-o://a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644" gracePeriod=30 May 29 00:55:55.019987 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.019966 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:55.132034 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.131966 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp454\" (UniqueName: \"kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454\") pod \"ff18162a-f65d-47dc-8fe6-496b606c4054\" (UID: \"ff18162a-f65d-47dc-8fe6-496b606c4054\") " May 29 00:55:55.133937 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.133911 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454" (OuterVolumeSpecName: "kube-api-access-bp454") pod "ff18162a-f65d-47dc-8fe6-496b606c4054" (UID: "ff18162a-f65d-47dc-8fe6-496b606c4054"). InnerVolumeSpecName "kube-api-access-bp454". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:55:55.233198 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.233170 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp454\" (UniqueName: \"kubernetes.io/projected/ff18162a-f65d-47dc-8fe6-496b606c4054-kube-api-access-bp454\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:55:55.789162 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.789133 2570 generic.go:358] "Generic (PLEG): container finished" podID="ff18162a-f65d-47dc-8fe6-496b606c4054" containerID="a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644" exitCode=0 May 29 00:55:55.789526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.789181 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" May 29 00:55:55.789526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.789182 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" event={"ID":"ff18162a-f65d-47dc-8fe6-496b606c4054","Type":"ContainerDied","Data":"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644"} May 29 00:55:55.789526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.789284 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vvj99" event={"ID":"ff18162a-f65d-47dc-8fe6-496b606c4054","Type":"ContainerDied","Data":"78b29fc99120a7bdd1ebe71fa4853c1b68136c2212eded907ad128d5839e9282"} May 29 00:55:55.789526 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.789301 2570 scope.go:117] "RemoveContainer" containerID="a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644" May 29 00:55:55.798666 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.798645 2570 scope.go:117] "RemoveContainer" containerID="a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644" May 29 00:55:55.798924 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:55:55.798903 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644\": container with ID starting with a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644 not found: ID does not exist" containerID="a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644" May 29 00:55:55.798992 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.798935 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644"} err="failed to get container status \"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644\": rpc error: code = NotFound desc = could not find container \"a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644\": container with ID starting with a39a28cc4ea88e1917b47dbc058647391c03315e4cfa2a91c5f5ee14a24b3644 not found: ID does not exist" May 29 00:55:55.809307 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.809288 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:55.812501 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:55.812462 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vvj99"] May 29 00:55:56.089697 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:55:56.089675 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff18162a-f65d-47dc-8fe6-496b606c4054" path="/var/lib/kubelet/pods/ff18162a-f65d-47dc-8fe6-496b606c4054/volumes" May 29 00:56:01.626842 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:01.626809 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:56:01.627219 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:01.627050 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" podUID="b12d7801-3edf-44de-a3a1-bb9ee989b635" containerName="limitador" containerID="cri-o://f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc" gracePeriod=30 May 29 00:56:01.627624 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:01.627524 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:56:02.172314 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.172294 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:56:02.286190 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.286148 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file\") pod \"b12d7801-3edf-44de-a3a1-bb9ee989b635\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " May 29 00:56:02.286351 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.286341 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9tts\" (UniqueName: \"kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts\") pod \"b12d7801-3edf-44de-a3a1-bb9ee989b635\" (UID: \"b12d7801-3edf-44de-a3a1-bb9ee989b635\") " May 29 00:56:02.286559 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.286533 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file" (OuterVolumeSpecName: "config-file") pod "b12d7801-3edf-44de-a3a1-bb9ee989b635" (UID: "b12d7801-3edf-44de-a3a1-bb9ee989b635"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:56:02.288466 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.288438 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts" (OuterVolumeSpecName: "kube-api-access-m9tts") pod "b12d7801-3edf-44de-a3a1-bb9ee989b635" (UID: "b12d7801-3edf-44de-a3a1-bb9ee989b635"). InnerVolumeSpecName "kube-api-access-m9tts". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:56:02.386947 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.386912 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9tts\" (UniqueName: \"kubernetes.io/projected/b12d7801-3edf-44de-a3a1-bb9ee989b635-kube-api-access-m9tts\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:56:02.386947 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.386942 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b12d7801-3edf-44de-a3a1-bb9ee989b635-config-file\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:56:02.817929 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.817875 2570 generic.go:358] "Generic (PLEG): container finished" podID="b12d7801-3edf-44de-a3a1-bb9ee989b635" containerID="f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc" exitCode=0 May 29 00:56:02.818351 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.817947 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" May 29 00:56:02.818351 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.817964 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" event={"ID":"b12d7801-3edf-44de-a3a1-bb9ee989b635","Type":"ContainerDied","Data":"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc"} May 29 00:56:02.818351 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.818004 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2wbs" event={"ID":"b12d7801-3edf-44de-a3a1-bb9ee989b635","Type":"ContainerDied","Data":"4570eb339bd2cad3b7380c3771912665e74f1b17e5d46594289f8e12726e16c1"} May 29 00:56:02.818351 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.818023 2570 scope.go:117] "RemoveContainer" containerID="f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc" May 29 00:56:02.826564 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.826550 2570 scope.go:117] "RemoveContainer" containerID="f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc" May 29 00:56:02.826819 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:56:02.826800 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc\": container with ID starting with f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc not found: ID does not exist" containerID="f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc" May 29 00:56:02.826874 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.826827 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc"} err="failed to get container status \"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc\": rpc error: code = NotFound desc = could not find container \"f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc\": container with ID starting with f1a50d761a77fff94c52226534c7d259f0e1f937ec5b42f91d9831185a1dfacc not found: ID does not exist" May 29 00:56:02.837869 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.837842 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:56:02.841320 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:02.841293 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2wbs"] May 29 00:56:04.089986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:04.089951 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12d7801-3edf-44de-a3a1-bb9ee989b635" path="/var/lib/kubelet/pods/b12d7801-3edf-44de-a3a1-bb9ee989b635/volumes" May 29 00:56:16.270061 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.269996 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh"] May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270257 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff18162a-f65d-47dc-8fe6-496b606c4054" containerName="authorino" May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270267 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff18162a-f65d-47dc-8fe6-496b606c4054" containerName="authorino" May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270281 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12d7801-3edf-44de-a3a1-bb9ee989b635" containerName="limitador" May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270286 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12d7801-3edf-44de-a3a1-bb9ee989b635" containerName="limitador" May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270328 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b12d7801-3edf-44de-a3a1-bb9ee989b635" containerName="limitador" May 29 00:56:16.270398 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.270336 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff18162a-f65d-47dc-8fe6-496b606c4054" containerName="authorino" May 29 00:56:16.273617 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.273601 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.276335 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.276318 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 29 00:56:16.277353 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.277335 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 29 00:56:16.277409 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.277344 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r5l94\"" May 29 00:56:16.281503 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.281484 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh"] May 29 00:56:16.403670 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.403639 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.403836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.403697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44l68\" (UniqueName: \"kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.403836 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.403794 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.504498 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.504463 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.504634 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.504529 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44l68\" (UniqueName: \"kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.504634 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.504576 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.504832 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.504808 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.504928 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.504909 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.513710 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.513689 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44l68\" (UniqueName: \"kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.583314 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.583263 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:16.702866 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.702842 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh"] May 29 00:56:16.704381 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:56:16.704343 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72033ac_45b0_424e_9377_697c156557cd.slice/crio-c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79 WatchSource:0}: Error finding container c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79: Status 404 returned error can't find the container with id c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79 May 29 00:56:16.870347 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.870280 2570 generic.go:358] "Generic (PLEG): container finished" podID="b72033ac-45b0-424e-9377-697c156557cd" containerID="17910aec820f864139ecd0528f73f5cb63abee7cbb42e128440ff5a2bada848a" exitCode=0 May 29 00:56:16.870453 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.870361 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" event={"ID":"b72033ac-45b0-424e-9377-697c156557cd","Type":"ContainerDied","Data":"17910aec820f864139ecd0528f73f5cb63abee7cbb42e128440ff5a2bada848a"} May 29 00:56:16.870453 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:16.870391 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" event={"ID":"b72033ac-45b0-424e-9377-697c156557cd","Type":"ContainerStarted","Data":"c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79"} May 29 00:56:17.875001 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:17.874917 2570 generic.go:358] "Generic (PLEG): container finished" podID="b72033ac-45b0-424e-9377-697c156557cd" containerID="3f9b59927e4a9f8d2831622a478d9d71935365b222704938c5e07984e831e10e" exitCode=0 May 29 00:56:17.875001 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:17.874979 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" event={"ID":"b72033ac-45b0-424e-9377-697c156557cd","Type":"ContainerDied","Data":"3f9b59927e4a9f8d2831622a478d9d71935365b222704938c5e07984e831e10e"} May 29 00:56:18.881250 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:18.881218 2570 generic.go:358] "Generic (PLEG): container finished" podID="b72033ac-45b0-424e-9377-697c156557cd" containerID="4703b47b56d7a171599e239b5c13a044b0e2d3e0afe5344c914cdc6bb660af50" exitCode=0 May 29 00:56:18.881593 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:18.881303 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" event={"ID":"b72033ac-45b0-424e-9377-697c156557cd","Type":"ContainerDied","Data":"4703b47b56d7a171599e239b5c13a044b0e2d3e0afe5344c914cdc6bb660af50"} May 29 00:56:20.014867 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.014846 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:20.131744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.131717 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44l68\" (UniqueName: \"kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68\") pod \"b72033ac-45b0-424e-9377-697c156557cd\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " May 29 00:56:20.131903 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.131760 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle\") pod \"b72033ac-45b0-424e-9377-697c156557cd\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " May 29 00:56:20.131903 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.131811 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util\") pod \"b72033ac-45b0-424e-9377-697c156557cd\" (UID: \"b72033ac-45b0-424e-9377-697c156557cd\") " May 29 00:56:20.132425 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.132399 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle" (OuterVolumeSpecName: "bundle") pod "b72033ac-45b0-424e-9377-697c156557cd" (UID: "b72033ac-45b0-424e-9377-697c156557cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:56:20.133751 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.133726 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68" (OuterVolumeSpecName: "kube-api-access-44l68") pod "b72033ac-45b0-424e-9377-697c156557cd" (UID: "b72033ac-45b0-424e-9377-697c156557cd"). InnerVolumeSpecName "kube-api-access-44l68". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:56:20.138037 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.137984 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util" (OuterVolumeSpecName: "util") pod "b72033ac-45b0-424e-9377-697c156557cd" (UID: "b72033ac-45b0-424e-9377-697c156557cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 00:56:20.232872 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.232846 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44l68\" (UniqueName: \"kubernetes.io/projected/b72033ac-45b0-424e-9377-697c156557cd-kube-api-access-44l68\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:56:20.232872 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.232868 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-bundle\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:56:20.233008 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.232878 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72033ac-45b0-424e-9377-697c156557cd-util\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:56:20.891197 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.891163 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" event={"ID":"b72033ac-45b0-424e-9377-697c156557cd","Type":"ContainerDied","Data":"c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79"} May 29 00:56:20.891197 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.891192 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70jppzh" May 29 00:56:20.891402 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:20.891195 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5ed989d1bce459b5545c007c295e938538bf4110d21ae97559054c75dd09a79" May 29 00:56:23.490440 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490406 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-kjrjh"] May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490701 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="util" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490712 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="util" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490723 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="pull" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490728 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="pull" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490746 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="extract" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490751 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="extract" May 29 00:56:23.490823 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.490815 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b72033ac-45b0-424e-9377-697c156557cd" containerName="extract" May 29 00:56:23.563983 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.563954 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-kjrjh"] May 29 00:56:23.564124 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.564062 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" May 29 00:56:23.566974 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.566947 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 00:56:23.567094 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.567007 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 00:56:23.567094 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.567034 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-dn8vq\"" May 29 00:56:23.659845 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.659823 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62cxb\" (UniqueName: \"kubernetes.io/projected/aaa7d76f-b6ba-4f30-9306-5c97884a69cd-kube-api-access-62cxb\") pod \"keycloak-operator-7864d68cbd-kjrjh\" (UID: \"aaa7d76f-b6ba-4f30-9306-5c97884a69cd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" May 29 00:56:23.760841 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.760771 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62cxb\" (UniqueName: \"kubernetes.io/projected/aaa7d76f-b6ba-4f30-9306-5c97884a69cd-kube-api-access-62cxb\") pod \"keycloak-operator-7864d68cbd-kjrjh\" (UID: \"aaa7d76f-b6ba-4f30-9306-5c97884a69cd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" May 29 00:56:23.768275 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.768253 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62cxb\" (UniqueName: \"kubernetes.io/projected/aaa7d76f-b6ba-4f30-9306-5c97884a69cd-kube-api-access-62cxb\") pod \"keycloak-operator-7864d68cbd-kjrjh\" (UID: \"aaa7d76f-b6ba-4f30-9306-5c97884a69cd\") " pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" May 29 00:56:23.874371 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.874343 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" May 29 00:56:23.999316 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:23.999288 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-kjrjh"] May 29 00:56:24.000985 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:56:24.000957 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa7d76f_b6ba_4f30_9306_5c97884a69cd.slice/crio-3335477068d26fcb13670440aa0bae72d2725f6a5036548fb59a890c2c07f4ae WatchSource:0}: Error finding container 3335477068d26fcb13670440aa0bae72d2725f6a5036548fb59a890c2c07f4ae: Status 404 returned error can't find the container with id 3335477068d26fcb13670440aa0bae72d2725f6a5036548fb59a890c2c07f4ae May 29 00:56:24.907472 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:24.907438 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" event={"ID":"aaa7d76f-b6ba-4f30-9306-5c97884a69cd","Type":"ContainerStarted","Data":"3335477068d26fcb13670440aa0bae72d2725f6a5036548fb59a890c2c07f4ae"} May 29 00:56:29.930419 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:29.930373 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" event={"ID":"aaa7d76f-b6ba-4f30-9306-5c97884a69cd","Type":"ContainerStarted","Data":"64e025e456e498c536e05b24633ea6c94d01e0b5284404b0859c8b34a473ce53"} May 29 00:56:29.947328 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:56:29.947265 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-kjrjh" podStartSLOduration=1.221723623 podStartE2EDuration="6.947249998s" podCreationTimestamp="2026-05-29 00:56:23 +0000 UTC" firstStartedPulling="2026-05-29 00:56:24.002827763 +0000 UTC m=+548.613899074" lastFinishedPulling="2026-05-29 00:56:29.728354138 +0000 UTC m=+554.339425449" observedRunningTime="2026-05-29 00:56:29.945116197 +0000 UTC m=+554.556187522" watchObservedRunningTime="2026-05-29 00:56:29.947249998 +0000 UTC m=+554.558321331" May 29 00:57:08.309984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.309937 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:08.312766 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.312736 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:08.321879 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.321848 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:08.414312 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.414282 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wf7\" (UniqueName: \"kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7\") pod \"authorino-8b475cf9f-qcfq4\" (UID: \"a96f0be0-e303-435b-a611-a3e1d780d42b\") " pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:08.515422 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.515388 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wf7\" (UniqueName: \"kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7\") pod \"authorino-8b475cf9f-qcfq4\" (UID: \"a96f0be0-e303-435b-a611-a3e1d780d42b\") " pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:08.523193 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.523169 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wf7\" (UniqueName: \"kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7\") pod \"authorino-8b475cf9f-qcfq4\" (UID: \"a96f0be0-e303-435b-a611-a3e1d780d42b\") " pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:08.531966 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.531945 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:08.532111 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.532100 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:08.554883 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.554860 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:08.558262 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.558245 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:08.572590 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.572566 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:08.616522 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.616490 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffcz\" (UniqueName: \"kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz\") pod \"authorino-5898cd4488-bbtd4\" (UID: \"effc6eed-6a47-4855-b9f6-e0b205e76719\") " pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:08.668036 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.668007 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:08.669097 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:57:08.669060 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda96f0be0_e303_435b_a611_a3e1d780d42b.slice/crio-29fcf2900e1b13ec5fff8901746240eb5f9d54f9edc0c8256cfbe2201def553e WatchSource:0}: Error finding container 29fcf2900e1b13ec5fff8901746240eb5f9d54f9edc0c8256cfbe2201def553e: Status 404 returned error can't find the container with id 29fcf2900e1b13ec5fff8901746240eb5f9d54f9edc0c8256cfbe2201def553e May 29 00:57:08.717802 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.717744 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffcz\" (UniqueName: \"kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz\") pod \"authorino-5898cd4488-bbtd4\" (UID: \"effc6eed-6a47-4855-b9f6-e0b205e76719\") " pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:08.725276 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.725256 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffcz\" (UniqueName: \"kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz\") pod \"authorino-5898cd4488-bbtd4\" (UID: \"effc6eed-6a47-4855-b9f6-e0b205e76719\") " pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:08.867677 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.867624 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:08.989127 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.989101 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:08.990364 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:57:08.990337 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeffc6eed_6a47_4855_b9f6_e0b205e76719.slice/crio-513d5c5c3cfd5802f4a54b13276dfb91d0c6a2f07d556f854492cb5fb6687275 WatchSource:0}: Error finding container 513d5c5c3cfd5802f4a54b13276dfb91d0c6a2f07d556f854492cb5fb6687275: Status 404 returned error can't find the container with id 513d5c5c3cfd5802f4a54b13276dfb91d0c6a2f07d556f854492cb5fb6687275 May 29 00:57:08.994958 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:08.994939 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:09.013758 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.013736 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:57:09.016742 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.016727 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.019102 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.019086 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 29 00:57:09.024540 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.024513 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:57:09.070405 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.070381 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5898cd4488-bbtd4" event={"ID":"effc6eed-6a47-4855-b9f6-e0b205e76719","Type":"ContainerStarted","Data":"513d5c5c3cfd5802f4a54b13276dfb91d0c6a2f07d556f854492cb5fb6687275"} May 29 00:57:09.071549 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.071526 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" event={"ID":"a96f0be0-e303-435b-a611-a3e1d780d42b","Type":"ContainerStarted","Data":"29fcf2900e1b13ec5fff8901746240eb5f9d54f9edc0c8256cfbe2201def553e"} May 29 00:57:09.120855 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.120838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwp8\" (UniqueName: \"kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.120928 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.120868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.222119 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.222085 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwp8\" (UniqueName: \"kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.222119 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.222130 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.224417 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.224393 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.229102 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.229084 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwp8\" (UniqueName: \"kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8\") pod \"authorino-7c995985c6-ljgtc\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.326007 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.325987 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:57:09.461383 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:09.461359 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:57:09.462716 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:57:09.462674 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09118d6c_f7be_49e1_80fd_14e32bae4925.slice/crio-7af7f52724e1dfe080869d871df8ddecd6a2ee9922e0193d6047fe63c5179490 WatchSource:0}: Error finding container 7af7f52724e1dfe080869d871df8ddecd6a2ee9922e0193d6047fe63c5179490: Status 404 returned error can't find the container with id 7af7f52724e1dfe080869d871df8ddecd6a2ee9922e0193d6047fe63c5179490 May 29 00:57:10.076606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.076505 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" event={"ID":"a96f0be0-e303-435b-a611-a3e1d780d42b","Type":"ContainerStarted","Data":"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878"} May 29 00:57:10.076845 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.076621 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" podUID="a96f0be0-e303-435b-a611-a3e1d780d42b" containerName="authorino" containerID="cri-o://22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878" gracePeriod=30 May 29 00:57:10.077879 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.077847 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c995985c6-ljgtc" event={"ID":"09118d6c-f7be-49e1-80fd-14e32bae4925","Type":"ContainerStarted","Data":"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916"} May 29 00:57:10.077986 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.077884 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c995985c6-ljgtc" event={"ID":"09118d6c-f7be-49e1-80fd-14e32bae4925","Type":"ContainerStarted","Data":"7af7f52724e1dfe080869d871df8ddecd6a2ee9922e0193d6047fe63c5179490"} May 29 00:57:10.079197 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.079173 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5898cd4488-bbtd4" event={"ID":"effc6eed-6a47-4855-b9f6-e0b205e76719","Type":"ContainerStarted","Data":"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7"} May 29 00:57:10.079303 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.079230 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5898cd4488-bbtd4" podUID="effc6eed-6a47-4855-b9f6-e0b205e76719" containerName="authorino" containerID="cri-o://26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7" gracePeriod=30 May 29 00:57:10.093716 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.093679 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" podStartSLOduration=1.6939890850000001 podStartE2EDuration="2.093668709s" podCreationTimestamp="2026-05-29 00:57:08 +0000 UTC" firstStartedPulling="2026-05-29 00:57:08.670287308 +0000 UTC m=+593.281358619" lastFinishedPulling="2026-05-29 00:57:09.069966928 +0000 UTC m=+593.681038243" observedRunningTime="2026-05-29 00:57:10.090281419 +0000 UTC m=+594.701352749" watchObservedRunningTime="2026-05-29 00:57:10.093668709 +0000 UTC m=+594.704740041" May 29 00:57:10.105195 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.105160 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5898cd4488-bbtd4" podStartSLOduration=1.789796255 podStartE2EDuration="2.105148688s" podCreationTimestamp="2026-05-29 00:57:08 +0000 UTC" firstStartedPulling="2026-05-29 00:57:08.99168235 +0000 UTC m=+593.602753661" lastFinishedPulling="2026-05-29 00:57:09.307034781 +0000 UTC m=+593.918106094" observedRunningTime="2026-05-29 00:57:10.103466835 +0000 UTC m=+594.714538168" watchObservedRunningTime="2026-05-29 00:57:10.105148688 +0000 UTC m=+594.716220040" May 29 00:57:10.117263 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.117226 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7c995985c6-ljgtc" podStartSLOduration=1.810122086 podStartE2EDuration="2.117217202s" podCreationTimestamp="2026-05-29 00:57:08 +0000 UTC" firstStartedPulling="2026-05-29 00:57:09.464052766 +0000 UTC m=+594.075124077" lastFinishedPulling="2026-05-29 00:57:09.771147877 +0000 UTC m=+594.382219193" observedRunningTime="2026-05-29 00:57:10.116228551 +0000 UTC m=+594.727299883" watchObservedRunningTime="2026-05-29 00:57:10.117217202 +0000 UTC m=+594.728288575" May 29 00:57:10.146060 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.146036 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:57:10.146264 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.146243 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-rkff2" podUID="cc9ab10e-868d-459e-9d7c-5d845b58098a" containerName="authorino" containerID="cri-o://e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25" gracePeriod=30 May 29 00:57:10.388017 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.387993 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:10.420992 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.420970 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:10.426557 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.426540 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:57:10.532679 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.532653 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rp9m\" (UniqueName: \"kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m\") pod \"cc9ab10e-868d-459e-9d7c-5d845b58098a\" (UID: \"cc9ab10e-868d-459e-9d7c-5d845b58098a\") " May 29 00:57:10.532796 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.532693 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ffcz\" (UniqueName: \"kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz\") pod \"effc6eed-6a47-4855-b9f6-e0b205e76719\" (UID: \"effc6eed-6a47-4855-b9f6-e0b205e76719\") " May 29 00:57:10.532796 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.532733 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8wf7\" (UniqueName: \"kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7\") pod \"a96f0be0-e303-435b-a611-a3e1d780d42b\" (UID: \"a96f0be0-e303-435b-a611-a3e1d780d42b\") " May 29 00:57:10.535003 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.534976 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz" (OuterVolumeSpecName: "kube-api-access-5ffcz") pod "effc6eed-6a47-4855-b9f6-e0b205e76719" (UID: "effc6eed-6a47-4855-b9f6-e0b205e76719"). InnerVolumeSpecName "kube-api-access-5ffcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:57:10.535003 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.534998 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m" (OuterVolumeSpecName: "kube-api-access-8rp9m") pod "cc9ab10e-868d-459e-9d7c-5d845b58098a" (UID: "cc9ab10e-868d-459e-9d7c-5d845b58098a"). InnerVolumeSpecName "kube-api-access-8rp9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:57:10.535129 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.534977 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7" (OuterVolumeSpecName: "kube-api-access-g8wf7") pod "a96f0be0-e303-435b-a611-a3e1d780d42b" (UID: "a96f0be0-e303-435b-a611-a3e1d780d42b"). InnerVolumeSpecName "kube-api-access-g8wf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:57:10.633972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.633921 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rp9m\" (UniqueName: \"kubernetes.io/projected/cc9ab10e-868d-459e-9d7c-5d845b58098a-kube-api-access-8rp9m\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:57:10.633972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.633943 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ffcz\" (UniqueName: \"kubernetes.io/projected/effc6eed-6a47-4855-b9f6-e0b205e76719-kube-api-access-5ffcz\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:57:10.633972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:10.633955 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8wf7\" (UniqueName: \"kubernetes.io/projected/a96f0be0-e303-435b-a611-a3e1d780d42b-kube-api-access-g8wf7\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:57:11.084710 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.084677 2570 generic.go:358] "Generic (PLEG): container finished" podID="effc6eed-6a47-4855-b9f6-e0b205e76719" containerID="26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7" exitCode=0 May 29 00:57:11.084851 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.084732 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5898cd4488-bbtd4" May 29 00:57:11.084851 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.084793 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5898cd4488-bbtd4" event={"ID":"effc6eed-6a47-4855-b9f6-e0b205e76719","Type":"ContainerDied","Data":"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7"} May 29 00:57:11.084851 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.084838 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5898cd4488-bbtd4" event={"ID":"effc6eed-6a47-4855-b9f6-e0b205e76719","Type":"ContainerDied","Data":"513d5c5c3cfd5802f4a54b13276dfb91d0c6a2f07d556f854492cb5fb6687275"} May 29 00:57:11.085029 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.084860 2570 scope.go:117] "RemoveContainer" containerID="26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7" May 29 00:57:11.086268 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.086242 2570 generic.go:358] "Generic (PLEG): container finished" podID="a96f0be0-e303-435b-a611-a3e1d780d42b" containerID="22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878" exitCode=0 May 29 00:57:11.086362 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.086281 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" May 29 00:57:11.086362 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.086343 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" event={"ID":"a96f0be0-e303-435b-a611-a3e1d780d42b","Type":"ContainerDied","Data":"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878"} May 29 00:57:11.086475 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.086378 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qcfq4" event={"ID":"a96f0be0-e303-435b-a611-a3e1d780d42b","Type":"ContainerDied","Data":"29fcf2900e1b13ec5fff8901746240eb5f9d54f9edc0c8256cfbe2201def553e"} May 29 00:57:11.087723 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.087687 2570 generic.go:358] "Generic (PLEG): container finished" podID="cc9ab10e-868d-459e-9d7c-5d845b58098a" containerID="e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25" exitCode=0 May 29 00:57:11.087857 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.087763 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rkff2" May 29 00:57:11.087857 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.087726 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rkff2" event={"ID":"cc9ab10e-868d-459e-9d7c-5d845b58098a","Type":"ContainerDied","Data":"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25"} May 29 00:57:11.087857 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.087832 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rkff2" event={"ID":"cc9ab10e-868d-459e-9d7c-5d845b58098a","Type":"ContainerDied","Data":"1157bd6890ab0e1a26bdbb1289bb4510475d2bf6a2dfa3ae8b8fe9a7e0f51257"} May 29 00:57:11.095008 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.094984 2570 scope.go:117] "RemoveContainer" containerID="26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7" May 29 00:57:11.095342 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:57:11.095308 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7\": container with ID starting with 26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7 not found: ID does not exist" containerID="26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7" May 29 00:57:11.095424 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.095346 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7"} err="failed to get container status \"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7\": rpc error: code = NotFound desc = could not find container \"26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7\": container with ID starting with 26f0d6576a426c3e46249d09748c389af4e9737e4333704e7eafa4a6ba390bc7 not found: ID does not exist" May 29 00:57:11.095424 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.095370 2570 scope.go:117] "RemoveContainer" containerID="22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878" May 29 00:57:11.104492 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.104473 2570 scope.go:117] "RemoveContainer" containerID="22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878" May 29 00:57:11.104729 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:57:11.104712 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878\": container with ID starting with 22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878 not found: ID does not exist" containerID="22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878" May 29 00:57:11.104796 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.104736 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878"} err="failed to get container status \"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878\": rpc error: code = NotFound desc = could not find container \"22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878\": container with ID starting with 22b4468b10788f36c9b8a525b0836dac1a05999149b29d84a39081ebc790c878 not found: ID does not exist" May 29 00:57:11.104796 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.104752 2570 scope.go:117] "RemoveContainer" containerID="e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25" May 29 00:57:11.110447 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.110425 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:11.114007 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.113983 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5898cd4488-bbtd4"] May 29 00:57:11.114332 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.114316 2570 scope.go:117] "RemoveContainer" containerID="e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25" May 29 00:57:11.114595 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:57:11.114576 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25\": container with ID starting with e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25 not found: ID does not exist" containerID="e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25" May 29 00:57:11.114655 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.114609 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25"} err="failed to get container status \"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25\": rpc error: code = NotFound desc = could not find container \"e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25\": container with ID starting with e1940a0ba827939aeb186b30bd45bbdcfc3a70a2483ccacb9cc83a8dcf994e25 not found: ID does not exist" May 29 00:57:11.119922 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.119901 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:57:11.125233 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.125210 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-rkff2"] May 29 00:57:11.134683 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.134663 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:11.136661 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:11.136644 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qcfq4"] May 29 00:57:12.096091 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:12.096054 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96f0be0-e303-435b-a611-a3e1d780d42b" path="/var/lib/kubelet/pods/a96f0be0-e303-435b-a611-a3e1d780d42b/volumes" May 29 00:57:12.096478 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:12.096384 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9ab10e-868d-459e-9d7c-5d845b58098a" path="/var/lib/kubelet/pods/cc9ab10e-868d-459e-9d7c-5d845b58098a/volumes" May 29 00:57:12.096791 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:12.096753 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="effc6eed-6a47-4855-b9f6-e0b205e76719" path="/var/lib/kubelet/pods/effc6eed-6a47-4855-b9f6-e0b205e76719/volumes" May 29 00:57:16.009470 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:16.009444 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:57:16.010443 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:57:16.010424 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 00:58:37.255233 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255194 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255494 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9ab10e-868d-459e-9d7c-5d845b58098a" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255505 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9ab10e-868d-459e-9d7c-5d845b58098a" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255516 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96f0be0-e303-435b-a611-a3e1d780d42b" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255523 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96f0be0-e303-435b-a611-a3e1d780d42b" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255530 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="effc6eed-6a47-4855-b9f6-e0b205e76719" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255537 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="effc6eed-6a47-4855-b9f6-e0b205e76719" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255596 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc9ab10e-868d-459e-9d7c-5d845b58098a" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255605 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="a96f0be0-e303-435b-a611-a3e1d780d42b" containerName="authorino" May 29 00:58:37.255744 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.255611 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="effc6eed-6a47-4855-b9f6-e0b205e76719" containerName="authorino" May 29 00:58:37.257875 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.257855 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.260591 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.260567 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" May 29 00:58:37.264871 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.264845 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 00:58:37.358897 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.358867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.359004 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.358907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.359004 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.358972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w7s2\" (UniqueName: \"kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.460000 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.459977 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.460108 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.460015 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w7s2\" (UniqueName: \"kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.460108 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.460096 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.460719 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.460682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.462443 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.462422 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.467486 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.467465 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w7s2\" (UniqueName: \"kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2\") pod \"authorino-7fc49d4656-mt99m\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.568603 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.568546 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:58:37.694895 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.694873 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 00:58:37.696767 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:58:37.696741 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb632a374_f497_4367_9aeb_ea5ca7e53f1f.slice/crio-7a35ca4d2ef77fc24cfa33974a7d4abff5ed6d57c19df3d70ad64b2df38c146f WatchSource:0}: Error finding container 7a35ca4d2ef77fc24cfa33974a7d4abff5ed6d57c19df3d70ad64b2df38c146f: Status 404 returned error can't find the container with id 7a35ca4d2ef77fc24cfa33974a7d4abff5ed6d57c19df3d70ad64b2df38c146f May 29 00:58:37.697993 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:37.697978 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 00:58:38.420960 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.420881 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc49d4656-mt99m" event={"ID":"b632a374-f497-4367-9aeb-ea5ca7e53f1f","Type":"ContainerStarted","Data":"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8"} May 29 00:58:38.420960 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.420920 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc49d4656-mt99m" event={"ID":"b632a374-f497-4367-9aeb-ea5ca7e53f1f","Type":"ContainerStarted","Data":"7a35ca4d2ef77fc24cfa33974a7d4abff5ed6d57c19df3d70ad64b2df38c146f"} May 29 00:58:38.436442 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.436395 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7fc49d4656-mt99m" podStartSLOduration=1.038387939 podStartE2EDuration="1.43638185s" podCreationTimestamp="2026-05-29 00:58:37 +0000 UTC" firstStartedPulling="2026-05-29 00:58:37.698096463 +0000 UTC m=+682.309167773" lastFinishedPulling="2026-05-29 00:58:38.09609037 +0000 UTC m=+682.707161684" observedRunningTime="2026-05-29 00:58:38.434949039 +0000 UTC m=+683.046020372" watchObservedRunningTime="2026-05-29 00:58:38.43638185 +0000 UTC m=+683.047453182" May 29 00:58:38.465560 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.465530 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:58:38.465802 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.465752 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7c995985c6-ljgtc" podUID="09118d6c-f7be-49e1-80fd-14e32bae4925" containerName="authorino" containerID="cri-o://cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916" gracePeriod=30 May 29 00:58:38.715540 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.715515 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:58:38.769940 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.769920 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjwp8\" (UniqueName: \"kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8\") pod \"09118d6c-f7be-49e1-80fd-14e32bae4925\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " May 29 00:58:38.770107 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.770087 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert\") pod \"09118d6c-f7be-49e1-80fd-14e32bae4925\" (UID: \"09118d6c-f7be-49e1-80fd-14e32bae4925\") " May 29 00:58:38.771949 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.771922 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8" (OuterVolumeSpecName: "kube-api-access-jjwp8") pod "09118d6c-f7be-49e1-80fd-14e32bae4925" (UID: "09118d6c-f7be-49e1-80fd-14e32bae4925"). InnerVolumeSpecName "kube-api-access-jjwp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:58:38.779150 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.779125 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "09118d6c-f7be-49e1-80fd-14e32bae4925" (UID: "09118d6c-f7be-49e1-80fd-14e32bae4925"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:58:38.871317 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.871297 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09118d6c-f7be-49e1-80fd-14e32bae4925-tls-cert\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:58:38.871409 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:38.871321 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjwp8\" (UniqueName: \"kubernetes.io/projected/09118d6c-f7be-49e1-80fd-14e32bae4925-kube-api-access-jjwp8\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:58:39.426812 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.426759 2570 generic.go:358] "Generic (PLEG): container finished" podID="09118d6c-f7be-49e1-80fd-14e32bae4925" containerID="cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916" exitCode=0 May 29 00:58:39.427208 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.426834 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c995985c6-ljgtc" May 29 00:58:39.427208 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.426849 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c995985c6-ljgtc" event={"ID":"09118d6c-f7be-49e1-80fd-14e32bae4925","Type":"ContainerDied","Data":"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916"} May 29 00:58:39.427208 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.426903 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c995985c6-ljgtc" event={"ID":"09118d6c-f7be-49e1-80fd-14e32bae4925","Type":"ContainerDied","Data":"7af7f52724e1dfe080869d871df8ddecd6a2ee9922e0193d6047fe63c5179490"} May 29 00:58:39.427208 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.426925 2570 scope.go:117] "RemoveContainer" containerID="cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916" May 29 00:58:39.436628 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.436613 2570 scope.go:117] "RemoveContainer" containerID="cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916" May 29 00:58:39.436922 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:58:39.436896 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916\": container with ID starting with cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916 not found: ID does not exist" containerID="cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916" May 29 00:58:39.437024 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.436927 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916"} err="failed to get container status \"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916\": rpc error: code = NotFound desc = could not find container \"cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916\": container with ID starting with cfbb1887fd20bb415ac1b01cf45136e9bec7a38088521c22f32d84b7f0223916 not found: ID does not exist" May 29 00:58:39.448892 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.448868 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:58:39.450896 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:39.450874 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c995985c6-ljgtc"] May 29 00:58:40.090680 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:58:40.090650 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09118d6c-f7be-49e1-80fd-14e32bae4925" path="/var/lib/kubelet/pods/09118d6c-f7be-49e1-80fd-14e32bae4925/volumes" May 29 00:59:08.078655 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.078570 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6"] May 29 00:59:08.079216 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.079048 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09118d6c-f7be-49e1-80fd-14e32bae4925" containerName="authorino" May 29 00:59:08.079216 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.079067 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="09118d6c-f7be-49e1-80fd-14e32bae4925" containerName="authorino" May 29 00:59:08.079216 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.079182 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="09118d6c-f7be-49e1-80fd-14e32bae4925" containerName="authorino" May 29 00:59:08.081661 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.081642 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.084190 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.084164 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 29 00:59:08.084298 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.084210 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 29 00:59:08.085428 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.085410 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 29 00:59:08.085521 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.085478 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5q8n9\"" May 29 00:59:08.092997 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.092975 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6"] May 29 00:59:08.192831 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.192795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.192941 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.192844 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efc2645-dcb7-413e-a48f-52cc5e4ab021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.192989 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.192942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.193031 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.192996 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.193211 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.193190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.193278 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.193234 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nt9\" (UniqueName: \"kubernetes.io/projected/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kube-api-access-v6nt9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.293992 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.293969 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294103 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294004 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294103 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294031 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294103 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294094 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nt9\" (UniqueName: \"kubernetes.io/projected/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kube-api-access-v6nt9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294223 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294131 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294223 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294152 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efc2645-dcb7-413e-a48f-52cc5e4ab021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294413 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294385 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294464 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294432 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.294510 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.294492 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.296394 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.296372 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4efc2645-dcb7-413e-a48f-52cc5e4ab021-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.296605 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.296588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efc2645-dcb7-413e-a48f-52cc5e4ab021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.301381 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.301362 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nt9\" (UniqueName: \"kubernetes.io/projected/4efc2645-dcb7-413e-a48f-52cc5e4ab021-kube-api-access-v6nt9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6\" (UID: \"4efc2645-dcb7-413e-a48f-52cc5e4ab021\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.394177 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.394119 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:08.517612 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.517587 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6"] May 29 00:59:08.519023 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:59:08.518999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efc2645_dcb7_413e_a48f_52cc5e4ab021.slice/crio-71594a83d7151a3f56fec080f0782e0cd7d5835ba0b1cfe5b39b00a0d0afa5dd WatchSource:0}: Error finding container 71594a83d7151a3f56fec080f0782e0cd7d5835ba0b1cfe5b39b00a0d0afa5dd: Status 404 returned error can't find the container with id 71594a83d7151a3f56fec080f0782e0cd7d5835ba0b1cfe5b39b00a0d0afa5dd May 29 00:59:08.548472 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:08.548442 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" event={"ID":"4efc2645-dcb7-413e-a48f-52cc5e4ab021","Type":"ContainerStarted","Data":"71594a83d7151a3f56fec080f0782e0cd7d5835ba0b1cfe5b39b00a0d0afa5dd"} May 29 00:59:14.572171 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:14.572135 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" event={"ID":"4efc2645-dcb7-413e-a48f-52cc5e4ab021","Type":"ContainerStarted","Data":"42548230f7b7a7997a3980ef1e45c4c89401a8d32ca9b14b7634ba2ddad8699a"} May 29 00:59:19.590667 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:19.590631 2570 generic.go:358] "Generic (PLEG): container finished" podID="4efc2645-dcb7-413e-a48f-52cc5e4ab021" containerID="42548230f7b7a7997a3980ef1e45c4c89401a8d32ca9b14b7634ba2ddad8699a" exitCode=0 May 29 00:59:19.591160 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:19.590707 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" event={"ID":"4efc2645-dcb7-413e-a48f-52cc5e4ab021","Type":"ContainerDied","Data":"42548230f7b7a7997a3980ef1e45c4c89401a8d32ca9b14b7634ba2ddad8699a"} May 29 00:59:21.602579 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:21.602549 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" event={"ID":"4efc2645-dcb7-413e-a48f-52cc5e4ab021","Type":"ContainerStarted","Data":"1de7791de18c4a2a3e249269fe0eb96ae6034bea75551ab90ac34c8080091209"} May 29 00:59:21.603004 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:21.602744 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:21.621184 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:21.621141 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" podStartSLOduration=1.5672202 podStartE2EDuration="13.621128983s" podCreationTimestamp="2026-05-29 00:59:08 +0000 UTC" firstStartedPulling="2026-05-29 00:59:08.520808332 +0000 UTC m=+713.131879645" lastFinishedPulling="2026-05-29 00:59:20.574717114 +0000 UTC m=+725.185788428" observedRunningTime="2026-05-29 00:59:21.618984595 +0000 UTC m=+726.230055927" watchObservedRunningTime="2026-05-29 00:59:21.621128983 +0000 UTC m=+726.232200315" May 29 00:59:30.482559 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.482523 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk"] May 29 00:59:30.657755 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.657720 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk"] May 29 00:59:30.657755 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.657743 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.660486 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.660469 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 29 00:59:30.770826 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.770944 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlfkk\" (UniqueName: \"kubernetes.io/projected/3c03778b-ace7-4201-bc88-767fa34df41c-kube-api-access-xlfkk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.770944 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c03778b-ace7-4201-bc88-767fa34df41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.770944 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.770944 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.771071 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.770968 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872158 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872127 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872177 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872206 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872232 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlfkk\" (UniqueName: \"kubernetes.io/projected/3c03778b-ace7-4201-bc88-767fa34df41c-kube-api-access-xlfkk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872250 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c03778b-ace7-4201-bc88-767fa34df41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872288 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872271 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872538 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872505 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872593 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872546 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.872647 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.872615 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.874550 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.874517 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c03778b-ace7-4201-bc88-767fa34df41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.874742 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.874726 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c03778b-ace7-4201-bc88-767fa34df41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.879418 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.879395 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlfkk\" (UniqueName: \"kubernetes.io/projected/3c03778b-ace7-4201-bc88-767fa34df41c-kube-api-access-xlfkk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk\" (UID: \"3c03778b-ace7-4201-bc88-767fa34df41c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:30.966431 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:30.966407 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:31.085558 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:31.085522 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk"] May 29 00:59:31.086877 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:59:31.086851 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c03778b_ace7_4201_bc88_767fa34df41c.slice/crio-7dcd29d4563e4a0727ca515a04e383e082551494f890c0d21fe03125a0cb6875 WatchSource:0}: Error finding container 7dcd29d4563e4a0727ca515a04e383e082551494f890c0d21fe03125a0cb6875: Status 404 returned error can't find the container with id 7dcd29d4563e4a0727ca515a04e383e082551494f890c0d21fe03125a0cb6875 May 29 00:59:31.640864 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:31.640830 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" event={"ID":"3c03778b-ace7-4201-bc88-767fa34df41c","Type":"ContainerStarted","Data":"70be41b4fb446aecd8195a326874865d15b1ab582bf35e7ed4392343b3124a46"} May 29 00:59:31.640864 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:31.640865 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" event={"ID":"3c03778b-ace7-4201-bc88-767fa34df41c","Type":"ContainerStarted","Data":"7dcd29d4563e4a0727ca515a04e383e082551494f890c0d21fe03125a0cb6875"} May 29 00:59:32.618156 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:32.618124 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6" May 29 00:59:39.671511 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:39.671466 2570 generic.go:358] "Generic (PLEG): container finished" podID="3c03778b-ace7-4201-bc88-767fa34df41c" containerID="70be41b4fb446aecd8195a326874865d15b1ab582bf35e7ed4392343b3124a46" exitCode=0 May 29 00:59:39.671972 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:39.671541 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" event={"ID":"3c03778b-ace7-4201-bc88-767fa34df41c","Type":"ContainerDied","Data":"70be41b4fb446aecd8195a326874865d15b1ab582bf35e7ed4392343b3124a46"} May 29 00:59:40.688155 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:40.688114 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" event={"ID":"3c03778b-ace7-4201-bc88-767fa34df41c","Type":"ContainerStarted","Data":"e45cae6f124f48a3aa6e3e6d2b12c8dd15c282c41967b417d0fb99f47a1092b9"} May 29 00:59:40.688527 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:40.688332 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:40.707235 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:40.707066 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" podStartSLOduration=10.516197367 podStartE2EDuration="10.707050633s" podCreationTimestamp="2026-05-29 00:59:30 +0000 UTC" firstStartedPulling="2026-05-29 00:59:39.672150177 +0000 UTC m=+744.283221488" lastFinishedPulling="2026-05-29 00:59:39.863003443 +0000 UTC m=+744.474074754" observedRunningTime="2026-05-29 00:59:40.704384757 +0000 UTC m=+745.315456089" watchObservedRunningTime="2026-05-29 00:59:40.707050633 +0000 UTC m=+745.318121965" May 29 00:59:51.704393 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:51.704359 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk" May 29 00:59:56.591222 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.591185 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56d84988f-nkmnx"] May 29 00:59:56.594808 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.594771 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.603814 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.603752 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56d84988f-nkmnx"] May 29 00:59:56.662673 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.662642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/82d394db-22da-4288-b0f4-98461aec7abe-oidc-ca\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.662814 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.662680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rhs\" (UniqueName: \"kubernetes.io/projected/82d394db-22da-4288-b0f4-98461aec7abe-kube-api-access-45rhs\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.662814 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.662750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d394db-22da-4288-b0f4-98461aec7abe-tls-cert\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.764063 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.764030 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/82d394db-22da-4288-b0f4-98461aec7abe-oidc-ca\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.764166 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.764071 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45rhs\" (UniqueName: \"kubernetes.io/projected/82d394db-22da-4288-b0f4-98461aec7abe-kube-api-access-45rhs\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.764166 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.764099 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d394db-22da-4288-b0f4-98461aec7abe-tls-cert\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.764651 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.764633 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/82d394db-22da-4288-b0f4-98461aec7abe-oidc-ca\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.766340 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.766324 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d394db-22da-4288-b0f4-98461aec7abe-tls-cert\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.771130 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.771109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rhs\" (UniqueName: \"kubernetes.io/projected/82d394db-22da-4288-b0f4-98461aec7abe-kube-api-access-45rhs\") pod \"authorino-56d84988f-nkmnx\" (UID: \"82d394db-22da-4288-b0f4-98461aec7abe\") " pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:56.904687 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:56.904637 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56d84988f-nkmnx" May 29 00:59:57.025280 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.025252 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56d84988f-nkmnx"] May 29 00:59:57.026731 ip-10-0-140-228 kubenswrapper[2570]: W0529 00:59:57.026705 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d394db_22da_4288_b0f4_98461aec7abe.slice/crio-742b62f161b179fc0df826f582ce0f6facaf279f85ed30e24661cda9ee043f7d WatchSource:0}: Error finding container 742b62f161b179fc0df826f582ce0f6facaf279f85ed30e24661cda9ee043f7d: Status 404 returned error can't find the container with id 742b62f161b179fc0df826f582ce0f6facaf279f85ed30e24661cda9ee043f7d May 29 00:59:57.754272 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.754242 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56d84988f-nkmnx" event={"ID":"82d394db-22da-4288-b0f4-98461aec7abe","Type":"ContainerStarted","Data":"944c7218a0252c6d816cfeee375c9e1c364d7be4b6b77d50ed9b85689db77e66"} May 29 00:59:57.754272 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.754277 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56d84988f-nkmnx" event={"ID":"82d394db-22da-4288-b0f4-98461aec7abe","Type":"ContainerStarted","Data":"742b62f161b179fc0df826f582ce0f6facaf279f85ed30e24661cda9ee043f7d"} May 29 00:59:57.772606 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.772544 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-56d84988f-nkmnx" podStartSLOduration=1.3974055029999999 podStartE2EDuration="1.772527957s" podCreationTimestamp="2026-05-29 00:59:56 +0000 UTC" firstStartedPulling="2026-05-29 00:59:57.027961571 +0000 UTC m=+761.639032882" lastFinishedPulling="2026-05-29 00:59:57.403084022 +0000 UTC m=+762.014155336" observedRunningTime="2026-05-29 00:59:57.77104575 +0000 UTC m=+762.382117082" watchObservedRunningTime="2026-05-29 00:59:57.772527957 +0000 UTC m=+762.383599290" May 29 00:59:57.802344 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.802310 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 00:59:57.802537 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:57.802514 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7fc49d4656-mt99m" podUID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" containerName="authorino" containerID="cri-o://5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8" gracePeriod=30 May 29 00:59:58.045913 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.045890 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:59:58.075090 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.075056 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert\") pod \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " May 29 00:59:58.075215 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.075149 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w7s2\" (UniqueName: \"kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2\") pod \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " May 29 00:59:58.075215 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.075178 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca\") pod \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\" (UID: \"b632a374-f497-4367-9aeb-ea5ca7e53f1f\") " May 29 00:59:58.077022 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.076998 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2" (OuterVolumeSpecName: "kube-api-access-5w7s2") pod "b632a374-f497-4367-9aeb-ea5ca7e53f1f" (UID: "b632a374-f497-4367-9aeb-ea5ca7e53f1f"). InnerVolumeSpecName "kube-api-access-5w7s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 00:59:58.080903 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.080872 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b632a374-f497-4367-9aeb-ea5ca7e53f1f" (UID: "b632a374-f497-4367-9aeb-ea5ca7e53f1f"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 00:59:58.083699 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.083677 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b632a374-f497-4367-9aeb-ea5ca7e53f1f" (UID: "b632a374-f497-4367-9aeb-ea5ca7e53f1f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 00:59:58.175868 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.175845 2570 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b632a374-f497-4367-9aeb-ea5ca7e53f1f-oidc-ca\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:59:58.175868 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.175865 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b632a374-f497-4367-9aeb-ea5ca7e53f1f-tls-cert\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:59:58.175984 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.175873 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w7s2\" (UniqueName: \"kubernetes.io/projected/b632a374-f497-4367-9aeb-ea5ca7e53f1f-kube-api-access-5w7s2\") on node \"ip-10-0-140-228.ec2.internal\" DevicePath \"\"" May 29 00:59:58.760326 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.760291 2570 generic.go:358] "Generic (PLEG): container finished" podID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" containerID="5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8" exitCode=0 May 29 00:59:58.760711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.760349 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc49d4656-mt99m" May 29 00:59:58.760711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.760380 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc49d4656-mt99m" event={"ID":"b632a374-f497-4367-9aeb-ea5ca7e53f1f","Type":"ContainerDied","Data":"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8"} May 29 00:59:58.760711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.760430 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc49d4656-mt99m" event={"ID":"b632a374-f497-4367-9aeb-ea5ca7e53f1f","Type":"ContainerDied","Data":"7a35ca4d2ef77fc24cfa33974a7d4abff5ed6d57c19df3d70ad64b2df38c146f"} May 29 00:59:58.760711 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.760447 2570 scope.go:117] "RemoveContainer" containerID="5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8" May 29 00:59:58.770355 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.770332 2570 scope.go:117] "RemoveContainer" containerID="5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8" May 29 00:59:58.770657 ip-10-0-140-228 kubenswrapper[2570]: E0529 00:59:58.770637 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8\": container with ID starting with 5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8 not found: ID does not exist" containerID="5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8" May 29 00:59:58.770703 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.770665 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8"} err="failed to get container status \"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8\": rpc error: code = NotFound desc = could not find container \"5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8\": container with ID starting with 5a519bc8c9f366fc40d733094e0b891ec19375b4367ddb96cda024cb6c485db8 not found: ID does not exist" May 29 00:59:58.776444 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.776419 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 00:59:58.782822 ip-10-0-140-228 kubenswrapper[2570]: I0529 00:59:58.782407 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fc49d4656-mt99m"] May 29 01:00:00.090364 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:00:00.090324 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" path="/var/lib/kubelet/pods/b632a374-f497-4367-9aeb-ea5ca7e53f1f/volumes" May 29 01:02:16.039689 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:02:16.039660 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:02:16.042907 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:02:16.042888 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:07:16.068132 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:07:16.068055 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:07:16.073026 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:07:16.073003 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:12:16.097735 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:12:16.097705 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:12:16.103242 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:12:16.103220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:17:16.128863 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:17:16.128832 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:17:16.135222 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:17:16.135200 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:22:16.166371 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:16.166314 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:22:16.174064 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:16.174031 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:22:38.216661 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:38.216629 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d84988f-nkmnx_82d394db-22da-4288-b0f4-98461aec7abe/authorino/0.log" May 29 01:22:43.426292 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:43.426258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d9b8687fd-jc2db_6e8a6216-87ae-4473-b9cf-5d9013bf66cb/manager/0.log" May 29 01:22:44.405554 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.405526 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/util/0.log" May 29 01:22:44.412482 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.412458 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/pull/0.log" May 29 01:22:44.418722 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.418699 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/extract/0.log" May 29 01:22:44.526528 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.526504 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/util/0.log" May 29 01:22:44.533237 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.533217 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/pull/0.log" May 29 01:22:44.539914 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.539897 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/extract/0.log" May 29 01:22:44.648314 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.648287 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/util/0.log" May 29 01:22:44.654682 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.654656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/pull/0.log" May 29 01:22:44.660629 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.660580 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/extract/0.log" May 29 01:22:44.766845 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.766820 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/util/0.log" May 29 01:22:44.773210 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.773187 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/pull/0.log" May 29 01:22:44.779322 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.779306 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/extract/0.log" May 29 01:22:44.895452 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:44.895421 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d84988f-nkmnx_82d394db-22da-4288-b0f4-98461aec7abe/authorino/0.log" May 29 01:22:45.133358 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:45.133330 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-6gdwd_0c6b90fa-0786-4da3-965d-4695765cb529/manager/0.log" May 29 01:22:45.243346 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:45.243321 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4pjf6_fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb/kuadrant-console-plugin/0.log" May 29 01:22:45.360981 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:45.360951 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvp8k_dd64d9f5-4426-44f0-8354-cd3fc589a0c5/registry-server/0.log" May 29 01:22:45.714318 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:45.714280 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-dknq9_90bdbfca-8138-47b9-8e78-7beb4451edcf/manager/0.log" May 29 01:22:46.053715 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:46.053686 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj_0a42636a-cf08-4d16-a2b8-2f8ae24a9af8/istio-proxy/0.log" May 29 01:22:46.526698 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:46.526655 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-r7cnb_3eb02f5e-38be-4935-9531-8897868fb67c/istio-proxy/0.log" May 29 01:22:47.100830 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:47.100803 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6_4efc2645-dcb7-413e-a48f-52cc5e4ab021/storage-initializer/0.log" May 29 01:22:47.111784 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:47.111759 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-rr5m6_4efc2645-dcb7-413e-a48f-52cc5e4ab021/main/0.log" May 29 01:22:47.681819 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:47.681759 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk_3c03778b-ace7-4201-bc88-767fa34df41c/storage-initializer/0.log" May 29 01:22:47.689749 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:47.689724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-w8dbk_3c03778b-ace7-4201-bc88-767fa34df41c/main/0.log" May 29 01:22:52.091158 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.091122 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-979vp/must-gather-pwlsp"] May 29 01:22:52.091602 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.091534 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" containerName="authorino" May 29 01:22:52.091602 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.091552 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" containerName="authorino" May 29 01:22:52.091711 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.091615 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b632a374-f497-4367-9aeb-ea5ca7e53f1f" containerName="authorino" May 29 01:22:52.093898 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.093878 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.096449 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.096414 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-979vp\"/\"openshift-service-ca.crt\"" May 29 01:22:52.097596 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.097576 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-979vp\"/\"default-dockercfg-pvr4b\"" May 29 01:22:52.097691 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.097580 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-979vp\"/\"kube-root-ca.crt\"" May 29 01:22:52.107337 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.107315 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/must-gather-pwlsp"] May 29 01:22:52.181139 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.181102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-must-gather-output\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.181324 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.181231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt4fg\" (UniqueName: \"kubernetes.io/projected/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-kube-api-access-pt4fg\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.282208 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.282160 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt4fg\" (UniqueName: \"kubernetes.io/projected/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-kube-api-access-pt4fg\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.282345 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.282231 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-must-gather-output\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.282612 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.282593 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-must-gather-output\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.290607 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.290584 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt4fg\" (UniqueName: \"kubernetes.io/projected/ab7ddca0-1b67-4bbb-9f5f-37a952947c08-kube-api-access-pt4fg\") pod \"must-gather-pwlsp\" (UID: \"ab7ddca0-1b67-4bbb-9f5f-37a952947c08\") " pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.403200 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.403110 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/must-gather-pwlsp" May 29 01:22:52.531465 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.531436 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/must-gather-pwlsp"] May 29 01:22:52.533133 ip-10-0-140-228 kubenswrapper[2570]: W0529 01:22:52.533103 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab7ddca0_1b67_4bbb_9f5f_37a952947c08.slice/crio-659910d2aec3f4e9a964533dc5bdaf0648c1bb4f82d3f0915d8cfc054a5b7ee2 WatchSource:0}: Error finding container 659910d2aec3f4e9a964533dc5bdaf0648c1bb4f82d3f0915d8cfc054a5b7ee2: Status 404 returned error can't find the container with id 659910d2aec3f4e9a964533dc5bdaf0648c1bb4f82d3f0915d8cfc054a5b7ee2 May 29 01:22:52.534752 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.534738 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 01:22:52.999541 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:52.999505 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/must-gather-pwlsp" event={"ID":"ab7ddca0-1b67-4bbb-9f5f-37a952947c08","Type":"ContainerStarted","Data":"659910d2aec3f4e9a964533dc5bdaf0648c1bb4f82d3f0915d8cfc054a5b7ee2"} May 29 01:22:54.008058 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:54.008016 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/must-gather-pwlsp" event={"ID":"ab7ddca0-1b67-4bbb-9f5f-37a952947c08","Type":"ContainerStarted","Data":"734dc8ec0d1e902e5b8a2e5277a4f81136939dff1f52f9ac9480fa17657acb04"} May 29 01:22:54.008561 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:54.008521 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/must-gather-pwlsp" event={"ID":"ab7ddca0-1b67-4bbb-9f5f-37a952947c08","Type":"ContainerStarted","Data":"8a0d79b0b3cf4b40b438a22352072a44b91f9f60e42fd58cf319b2f5d2a4bfff"} May 29 01:22:54.027476 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:54.027415 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-979vp/must-gather-pwlsp" podStartSLOduration=1.203626884 podStartE2EDuration="2.027397779s" podCreationTimestamp="2026-05-29 01:22:52 +0000 UTC" firstStartedPulling="2026-05-29 01:22:52.534870128 +0000 UTC m=+2137.145941439" lastFinishedPulling="2026-05-29 01:22:53.358641022 +0000 UTC m=+2137.969712334" observedRunningTime="2026-05-29 01:22:54.024582903 +0000 UTC m=+2138.635654236" watchObservedRunningTime="2026-05-29 01:22:54.027397779 +0000 UTC m=+2138.638469112" May 29 01:22:54.852554 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:54.852509 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7grvp_31cb6727-e341-4652-97b7-56a6e9ef26ae/global-pull-secret-syncer/0.log" May 29 01:22:55.026687 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:55.026656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v7x8c_8a7f5ec0-ec83-4cf7-9ba9-70dd476f7629/konnectivity-agent/0.log" May 29 01:22:55.063484 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:55.063451 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-228.ec2.internal_42adcfd06db77ec5a9455fbdef7bdeb1/haproxy/0.log" May 29 01:22:58.833913 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.833884 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/extract/0.log" May 29 01:22:58.854898 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.854869 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/util/0.log" May 29 01:22:58.875021 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.874980 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n7bdg_4d7152e7-8a49-4b9c-8ca3-405ee49a4642/pull/0.log" May 29 01:22:58.912943 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.912890 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/extract/0.log" May 29 01:22:58.933566 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.933516 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/util/0.log" May 29 01:22:58.960731 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.960692 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06l84d_3ce1f002-3f70-4fa8-b54b-aa7491d01545/pull/0.log" May 29 01:22:58.988395 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:58.988367 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/extract/0.log" May 29 01:22:59.008529 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.008477 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/util/0.log" May 29 01:22:59.032876 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.032841 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bbg9_79d2c63b-544a-4250-bf25-49a75adfdafb/pull/0.log" May 29 01:22:59.054485 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.054443 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/extract/0.log" May 29 01:22:59.076280 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.076247 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/util/0.log" May 29 01:22:59.095860 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.095747 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nvnj_56b9fa29-67df-41f4-85ea-4792f5c8cc73/pull/0.log" May 29 01:22:59.386522 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.386428 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d84988f-nkmnx_82d394db-22da-4288-b0f4-98461aec7abe/authorino/0.log" May 29 01:22:59.432278 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.432248 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-6gdwd_0c6b90fa-0786-4da3-965d-4695765cb529/manager/0.log" May 29 01:22:59.456017 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.455984 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4pjf6_fcd37c8a-3e72-4138-ac64-f1fc1bbed6fb/kuadrant-console-plugin/0.log" May 29 01:22:59.497308 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.496657 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvp8k_dd64d9f5-4426-44f0-8354-cd3fc589a0c5/registry-server/0.log" May 29 01:22:59.681636 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:22:59.681531 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-dknq9_90bdbfca-8138-47b9-8e78-7beb4451edcf/manager/0.log" May 29 01:23:01.187303 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:01.187275 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-744dd9ff75-pt79r_050ccf78-87a3-4925-9ee6-02c42f880979/metrics-server/0.log" May 29 01:23:01.318088 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:01.318060 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h764g_c8b15d23-a77c-498c-ac8f-7cfe1868267d/node-exporter/0.log" May 29 01:23:01.339669 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:01.339642 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h764g_c8b15d23-a77c-498c-ac8f-7cfe1868267d/kube-rbac-proxy/0.log" May 29 01:23:01.359848 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:01.359765 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h764g_c8b15d23-a77c-498c-ac8f-7cfe1868267d/init-textfile/0.log" May 29 01:23:03.451277 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.451233 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd"] May 29 01:23:03.455727 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.455703 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.465275 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.465238 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd"] May 29 01:23:03.497921 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.497886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446bw\" (UniqueName: \"kubernetes.io/projected/7b859ebd-6ef8-40f1-b038-9240dbc3edad-kube-api-access-446bw\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.497921 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.497933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-podres\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.498145 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.497962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-proc\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.498145 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.498023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-sys\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.498145 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.498070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-lib-modules\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599239 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599201 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-podres\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599256 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-proc\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599295 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-sys\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599327 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-proc\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599348 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-lib-modules\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599381 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-podres\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599421 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599407 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-sys\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599633 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599483 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446bw\" (UniqueName: \"kubernetes.io/projected/7b859ebd-6ef8-40f1-b038-9240dbc3edad-kube-api-access-446bw\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.599633 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.599506 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b859ebd-6ef8-40f1-b038-9240dbc3edad-lib-modules\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.608154 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.608123 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-446bw\" (UniqueName: \"kubernetes.io/projected/7b859ebd-6ef8-40f1-b038-9240dbc3edad-kube-api-access-446bw\") pod \"perf-node-gather-daemonset-5bvkd\" (UID: \"7b859ebd-6ef8-40f1-b038-9240dbc3edad\") " pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.767927 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.767892 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:03.939368 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:03.939339 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd"] May 29 01:23:03.941360 ip-10-0-140-228 kubenswrapper[2570]: W0529 01:23:03.940832 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b859ebd_6ef8_40f1_b038_9240dbc3edad.slice/crio-cd8b8678fb9cd87883c8772059424305d2c7b14571bb1c091205325598208347 WatchSource:0}: Error finding container cd8b8678fb9cd87883c8772059424305d2c7b14571bb1c091205325598208347: Status 404 returned error can't find the container with id cd8b8678fb9cd87883c8772059424305d2c7b14571bb1c091205325598208347 May 29 01:23:04.067298 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:04.067260 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" event={"ID":"7b859ebd-6ef8-40f1-b038-9240dbc3edad","Type":"ContainerStarted","Data":"cd8b8678fb9cd87883c8772059424305d2c7b14571bb1c091205325598208347"} May 29 01:23:05.074028 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.073923 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" event={"ID":"7b859ebd-6ef8-40f1-b038-9240dbc3edad","Type":"ContainerStarted","Data":"f2943640980fde5f79601f2b20dbf1d9b8e6dd44085b69a8ce58e565f5f4601b"} May 29 01:23:05.074456 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.074239 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:05.092404 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.092344 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" podStartSLOduration=2.092326762 podStartE2EDuration="2.092326762s" podCreationTimestamp="2026-05-29 01:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 01:23:05.090234348 +0000 UTC m=+2149.701305681" watchObservedRunningTime="2026-05-29 01:23:05.092326762 +0000 UTC m=+2149.703398096" May 29 01:23:05.217025 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.217001 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24zsk_f769af73-0a5d-4f6b-b238-d864ffc6f0ce/dns/0.log" May 29 01:23:05.235223 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.235198 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24zsk_f769af73-0a5d-4f6b-b238-d864ffc6f0ce/kube-rbac-proxy/0.log" May 29 01:23:05.376602 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.376530 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q87vg_73658a65-0421-461d-8fd2-6216b59395f0/dns-node-resolver/0.log" May 29 01:23:05.840502 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.840467 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fff7f4b85-srh7j_da7fde44-11fe-4d62-af91-9e1a90ed1bbd/registry/0.log" May 29 01:23:05.851424 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.851399 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fff7f4b85-srh7j_da7fde44-11fe-4d62-af91-9e1a90ed1bbd/registry/1.log" May 29 01:23:05.891427 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:05.891400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2z5p_1a161583-291f-4f20-be45-659b586dab15/node-ca/0.log" May 29 01:23:06.652983 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:06.652950 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bc4bvj_0a42636a-cf08-4d16-a2b8-2f8ae24a9af8/istio-proxy/0.log" May 29 01:23:06.926012 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:06.925898 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-r7cnb_3eb02f5e-38be-4935-9531-8897868fb67c/istio-proxy/0.log" May 29 01:23:07.513941 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:07.513899 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dwlss_1ece5a88-26a8-4a7a-8298-a19644ca0034/serve-healthcheck-canary/0.log" May 29 01:23:08.050495 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:08.050428 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxtgb_10b60d5d-8fc2-4c92-8946-91d1f87554ec/kube-rbac-proxy/0.log" May 29 01:23:08.068934 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:08.068910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxtgb_10b60d5d-8fc2-4c92-8946-91d1f87554ec/exporter/0.log" May 29 01:23:08.091889 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:08.091841 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxtgb_10b60d5d-8fc2-4c92-8946-91d1f87554ec/extractor/0.log" May 29 01:23:10.285270 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:10.285238 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d9b8687fd-jc2db_6e8a6216-87ae-4473-b9cf-5d9013bf66cb/manager/0.log" May 29 01:23:11.087257 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:11.087226 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-979vp/perf-node-gather-daemonset-5bvkd" May 29 01:23:11.498374 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:11.498339 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55ddb96654-jf9x9_45cb1298-5c46-464d-9eb0-850b0a66c10b/manager/0.log" May 29 01:23:17.404905 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.404876 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/kube-multus-additional-cni-plugins/0.log" May 29 01:23:17.424287 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.424258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/egress-router-binary-copy/0.log" May 29 01:23:17.443086 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.443061 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/cni-plugins/0.log" May 29 01:23:17.465464 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.465408 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/bond-cni-plugin/0.log" May 29 01:23:17.485355 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.485332 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/routeoverride-cni/0.log" May 29 01:23:17.504216 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.504190 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/whereabouts-cni-bincopy/0.log" May 29 01:23:17.523949 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.523922 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89m5t_48d9c284-18f3-4bda-adbf-99205f2f2e47/whereabouts-cni/0.log" May 29 01:23:17.581409 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.581373 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wp2th_663fa4f7-bded-42a1-b632-98cacf08650c/kube-multus/0.log" May 29 01:23:17.673314 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.673248 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tq5gk_88562b5d-f14a-4abe-9560-e83a77fbcbfa/network-metrics-daemon/0.log" May 29 01:23:17.693102 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:17.693079 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tq5gk_88562b5d-f14a-4abe-9560-e83a77fbcbfa/kube-rbac-proxy/0.log" May 29 01:23:19.111661 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.111631 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-controller/0.log" May 29 01:23:19.126588 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.126562 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/0.log" May 29 01:23:19.139524 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.139493 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovn-acl-logging/1.log" May 29 01:23:19.157164 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.157131 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/kube-rbac-proxy-node/0.log" May 29 01:23:19.176476 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.176453 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/kube-rbac-proxy-ovn-metrics/0.log" May 29 01:23:19.195741 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.195716 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/northd/0.log" May 29 01:23:19.214705 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.214679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/nbdb/0.log" May 29 01:23:19.234694 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.234674 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/sbdb/0.log" May 29 01:23:19.370365 ip-10-0-140-228 kubenswrapper[2570]: I0529 01:23:19.370286 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hn2k9_47acc28e-f210-4e99-a744-1c441f730948/ovnkube-controller/0.log"