May 27 17:40:55.248941 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 17:40:55.248955 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 17:40:55.248980 ip-10-0-129-78 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 17:40:55.249267 ip-10-0-129-78 systemd[1]: Failed to start Kubernetes Kubelet. May 27 17:41:05.385016 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 17:41:05.385037 ip-10-0-129-78 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 864f6bb0884947f2a385cbabaeb9f6ce -- May 27 17:43:17.430882 ip-10-0-129-78 systemd[1]: Starting Kubernetes Kubelet... May 27 17:43:17.936909 ip-10-0-129-78 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:17.936909 ip-10-0-129-78 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 17:43:17.936909 ip-10-0-129-78 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:17.936909 ip-10-0-129-78 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 17:43:17.936909 ip-10-0-129-78 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:17.940773 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.940615 2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944145 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944166 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944170 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944174 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944177 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944180 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:17.944173 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944183 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944186 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944189 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944193 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944199 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944202 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944205 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944208 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944211 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944213 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944216 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944219 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944221 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944225 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944228 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944231 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944235 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944238 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944241 2552 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:17.944425 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944243 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944246 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944249 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944252 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944254 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944257 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944259 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944262 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944265 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944268 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944270 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944272 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944275 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944278 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944280 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944283 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944286 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944289 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944291 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944294 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:17.944896 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944297 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944299 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944302 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944304 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944307 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944309 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944312 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944314 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944317 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944319 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944322 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944324 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944327 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944329 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944332 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944335 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944337 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944340 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944342 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944345 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:17.945388 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944347 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944350 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944352 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944355 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944357 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944360 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944363 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944365 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944368 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944370 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944373 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944375 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944378 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944381 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944383 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944386 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944389 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944394 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944398 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:17.945921 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944401 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944404 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944833 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944839 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944842 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944845 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944847 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944852 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944855 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944858 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944861 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944863 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944866 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944869 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944871 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944874 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944876 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944879 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944882 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944885 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:17.946379 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944889 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944892 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944895 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944897 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944900 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944905 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944908 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944911 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944915 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944918 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944921 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944924 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944927 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944929 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944932 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944935 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944938 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944940 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944943 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:17.947065 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944946 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944948 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944951 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944953 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944956 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944959 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944961 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944964 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944966 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944968 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944971 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944973 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944976 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944979 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944981 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944984 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944986 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944989 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944992 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944994 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:17.947652 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944996 2552 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.944999 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945002 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945005 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945007 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945010 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945012 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945015 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945017 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945019 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945022 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945024 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945027 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945030 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945033 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945036 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945038 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945041 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945044 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945046 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:17.948162 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945048 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945051 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945053 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945056 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945059 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945062 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945064 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945067 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.945070 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.945994 2552 flags.go:64] FLAG: --address="0.0.0.0" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946004 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946012 2552 flags.go:64] FLAG: --anonymous-auth="true" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946023 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946027 2552 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946031 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946036 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946041 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946044 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946047 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946050 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946054 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946057 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 17:43:17.948677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946060 2552 flags.go:64] FLAG: --cgroup-root="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946063 2552 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946067 2552 flags.go:64] FLAG: --client-ca-file="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946070 2552 flags.go:64] FLAG: --cloud-config="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946073 2552 flags.go:64] FLAG: --cloud-provider="external" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946076 2552 flags.go:64] FLAG: --cluster-dns="[]" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946080 2552 flags.go:64] FLAG: --cluster-domain="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946083 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946085 2552 flags.go:64] FLAG: --config-dir="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946088 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946092 2552 flags.go:64] FLAG: --container-log-max-files="5" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946096 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946099 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946102 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946106 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946109 2552 flags.go:64] FLAG: --contention-profiling="false" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946112 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946116 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946119 2552 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946122 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946126 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946129 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946132 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946135 2552 flags.go:64] FLAG: --enable-load-reader="false" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946138 2552 flags.go:64] FLAG: --enable-server="true" May 27 17:43:17.949214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946141 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946147 2552 flags.go:64] FLAG: --event-burst="100" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946150 2552 flags.go:64] FLAG: --event-qps="50" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946153 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946156 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946159 2552 flags.go:64] FLAG: --eviction-hard="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946163 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946166 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946169 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946172 2552 flags.go:64] FLAG: --eviction-soft="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946174 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946177 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946180 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946183 2552 flags.go:64] FLAG: --experimental-mounter-path="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946186 2552 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946189 2552 flags.go:64] FLAG: --fail-swap-on="true" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946191 2552 flags.go:64] FLAG: --feature-gates="" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946195 2552 flags.go:64] FLAG: --file-check-frequency="20s" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946199 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946202 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946205 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946208 2552 flags.go:64] FLAG: --healthz-port="10248" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946211 2552 flags.go:64] FLAG: --help="false" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946214 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-129-78.ec2.internal" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946218 2552 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 17:43:17.949856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946221 2552 flags.go:64] FLAG: --http-check-frequency="20s" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946224 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946227 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946231 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946233 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946236 2552 flags.go:64] FLAG: --image-service-endpoint="" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946239 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946242 2552 flags.go:64] FLAG: --kube-api-burst="100" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946245 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946249 2552 flags.go:64] FLAG: --kube-api-qps="50" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946252 2552 flags.go:64] FLAG: --kube-reserved="" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946255 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946258 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946262 2552 flags.go:64] FLAG: --kubelet-cgroups="" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946265 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946268 2552 flags.go:64] FLAG: --lock-file="" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946271 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946274 2552 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946277 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946282 2552 flags.go:64] FLAG: --log-json-split-stream="false" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946285 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946288 2552 flags.go:64] FLAG: --log-text-split-stream="false" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946291 2552 flags.go:64] FLAG: --logging-format="text" May 27 17:43:17.950476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946294 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946297 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946300 2552 flags.go:64] FLAG: --manifest-url="" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946303 2552 flags.go:64] FLAG: --manifest-url-header="" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946308 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946311 2552 flags.go:64] FLAG: --max-open-files="1000000" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946315 2552 flags.go:64] FLAG: --max-pods="110" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946318 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946322 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946326 2552 flags.go:64] FLAG: --memory-manager-policy="None" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946329 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946333 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946335 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946338 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946346 2552 flags.go:64] FLAG: --node-status-max-images="50" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946349 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946352 2552 flags.go:64] FLAG: --oom-score-adj="-999" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946355 2552 flags.go:64] FLAG: --pod-cidr="" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946358 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946411 2552 flags.go:64] FLAG: --pod-manifest-path="" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946452 2552 flags.go:64] FLAG: --pod-max-pids="-1" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946458 2552 flags.go:64] FLAG: --pods-per-core="0" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946464 2552 flags.go:64] FLAG: --port="10250" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946470 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 17:43:17.951050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946476 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a63f1a3a4f4acfd7" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946480 2552 flags.go:64] FLAG: --qos-reserved="" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946483 2552 flags.go:64] FLAG: --read-only-port="10255" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946487 2552 flags.go:64] FLAG: --register-node="true" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946491 2552 flags.go:64] FLAG: --register-schedulable="true" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946498 2552 flags.go:64] FLAG: --register-with-taints="" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946502 2552 flags.go:64] FLAG: --registry-burst="10" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946505 2552 flags.go:64] FLAG: --registry-qps="5" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946508 2552 flags.go:64] FLAG: --reserved-cpus="" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946512 2552 flags.go:64] FLAG: --reserved-memory="" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946517 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946522 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946529 2552 flags.go:64] FLAG: --rotate-certificates="false" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946538 2552 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.946543 2552 flags.go:64] FLAG: --runonce="false" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948484 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948668 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948676 2552 flags.go:64] FLAG: --seccomp-default="false" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948681 2552 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948685 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948689 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948693 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948696 2552 flags.go:64] FLAG: --storage-driver-password="root" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948699 2552 flags.go:64] FLAG: --storage-driver-secure="false" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948703 2552 flags.go:64] FLAG: --storage-driver-table="stats" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948706 2552 flags.go:64] FLAG: --storage-driver-user="root" May 27 17:43:17.951703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948709 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948713 2552 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948717 2552 flags.go:64] FLAG: --system-cgroups="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948720 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948731 2552 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948735 2552 flags.go:64] FLAG: --tls-cert-file="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948738 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948744 2552 flags.go:64] FLAG: --tls-min-version="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948747 2552 flags.go:64] FLAG: --tls-private-key-file="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948750 2552 flags.go:64] FLAG: --topology-manager-policy="none" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948753 2552 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948756 2552 flags.go:64] FLAG: --topology-manager-scope="container" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948760 2552 flags.go:64] FLAG: --v="2" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948774 2552 flags.go:64] FLAG: --version="false" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948778 2552 flags.go:64] FLAG: --vmodule="" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948784 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.948787 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948895 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948901 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948905 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948908 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948912 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948916 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:17.952329 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948919 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948923 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948926 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948929 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948932 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948934 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948938 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948940 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948943 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948946 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948948 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948951 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948954 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948956 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948959 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948961 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948964 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948966 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948969 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:17.952933 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948971 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948974 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948977 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948979 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948982 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948984 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948987 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948989 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948993 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948996 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.948999 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949002 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949005 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949008 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949010 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949014 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949016 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949019 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949021 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:17.953417 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949024 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949026 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949029 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949031 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949034 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949037 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949039 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949042 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949044 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949047 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949049 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949052 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949054 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949057 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949059 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949062 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949065 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949067 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949069 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949072 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:17.953915 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949075 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949078 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949085 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949088 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949090 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949094 2552 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949096 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949099 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949101 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949104 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949106 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949109 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949112 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949114 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949116 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949119 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949122 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949124 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949127 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949129 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:17.954398 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949132 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:17.954907 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.949134 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:17.954907 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.950064 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:17.958042 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.958019 2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 17:43:17.958042 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.958042 2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 17:43:17.958116 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958097 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:17.958116 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958105 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:17.958116 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958109 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:17.958116 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958113 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:17.958116 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958116 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958119 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958122 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958125 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958128 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958132 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958135 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958138 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958141 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958144 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958147 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958149 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958152 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958155 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958157 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958160 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958163 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958165 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958168 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:17.958250 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958170 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958173 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958175 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958178 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958181 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958183 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958186 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958189 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958193 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958195 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958198 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958201 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958203 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958206 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958208 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958212 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958215 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958218 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958220 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:17.958743 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958223 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958226 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958228 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958231 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958233 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958236 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958238 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958241 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958244 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958246 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958250 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958254 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958257 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958261 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958264 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958267 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958269 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958273 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958275 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:17.959226 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958278 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958281 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958284 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958287 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958290 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958293 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958295 2552 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958298 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958301 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958305 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958308 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958310 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958313 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958315 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958318 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958320 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958323 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958326 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958328 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958330 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:17.959761 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958333 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958335 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958338 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958340 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958343 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.958348 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958451 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958455 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958458 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958461 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958464 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958467 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958470 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958473 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958475 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:17.960270 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958479 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958482 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958485 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958487 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958490 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958492 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958496 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958499 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958501 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958504 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958507 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958509 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958512 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958514 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958517 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958519 2552 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958522 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958525 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958527 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958530 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:17.960656 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958532 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958535 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958537 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958540 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958542 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958545 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958547 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958550 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958564 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958567 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958570 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958574 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958577 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958579 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958585 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958588 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958591 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958594 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958597 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:17.961185 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958600 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958603 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958605 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958608 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958611 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958613 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958616 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958618 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958621 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958624 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958626 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958629 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958631 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958634 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958636 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958639 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958641 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958644 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958648 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958651 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:17.961674 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958654 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958657 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958659 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958662 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958665 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958668 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958671 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958673 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958682 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958685 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958688 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958691 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958694 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958697 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958700 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958702 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958705 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:17.962164 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:17.958707 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:17.962588 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.958712 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:17.962588 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.959605 2552 server.go:962] "Client rotation is on, will bootstrap in background" May 27 17:43:17.964598 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.964583 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 17:43:17.965755 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.965743 2552 server.go:1019] "Starting client certificate rotation" May 27 17:43:17.965861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.965843 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:43:17.965891 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.965885 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:43:17.993364 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.993340 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:43:17.995397 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:17.995382 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:43:18.009963 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.009945 2552 log.go:25] "Validated CRI v1 runtime API" May 27 17:43:18.016503 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.016485 2552 log.go:25] "Validated CRI v1 image API" May 27 17:43:18.018938 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.018919 2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 17:43:18.023273 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.023224 2552 fs.go:135] Filesystem UUIDs: map[2b0f09dc-6c70-4818-984d-208f85807e4d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fd108a8d-fd8d-49f6-a763-22bb9d7e0de4:/dev/nvme0n1p4] May 27 17:43:18.023337 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.023273 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 17:43:18.026189 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.026172 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:43:18.027632 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.027509 2552 manager.go:217] Machine: {Timestamp:2026-05-27 17:43:18.027009412 +0000 UTC m=+0.463341455 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099907 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23dc63364d22ef8b3f82d316bd1785 SystemUUID:ec23dc63-364d-22ef-8b3f-82d316bd1785 BootID:864f6bb0-8849-47f2-a385-cbabaeb9f6ce Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:d3:a5:d4:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:d3:a5:d4:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:5f:03:66:52:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 17:43:18.028353 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.028341 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 17:43:18.028451 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.028438 2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 17:43:18.029908 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.029880 2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 17:43:18.030059 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.029910 2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 17:43:18.030105 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.030066 2552 topology_manager.go:138] "Creating topology manager with none policy" May 27 17:43:18.030105 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.030075 2552 container_manager_linux.go:306] "Creating device plugin manager" May 27 17:43:18.030105 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.030083 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:43:18.031131 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.031120 2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:43:18.033131 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.033119 2552 state_mem.go:36] "Initialized new in-memory state store" May 27 17:43:18.033260 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.033250 2552 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 17:43:18.036203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.036190 2552 kubelet.go:491] "Attempting to sync node with API server" May 27 17:43:18.036259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.036208 2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 17:43:18.036259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.036223 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 17:43:18.036259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.036233 2552 kubelet.go:397] "Adding apiserver pod source" May 27 17:43:18.036259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.036249 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 17:43:18.037625 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.037612 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:43:18.037674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.037633 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:43:18.041302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.041285 2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 17:43:18.043806 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.043787 2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 17:43:18.046292 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046277 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046299 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046309 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046317 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046331 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046340 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046349 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 17:43:18.046368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046357 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 17:43:18.046615 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046380 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 17:43:18.046615 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046390 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 17:43:18.046615 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046408 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 17:43:18.046615 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.046418 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 17:43:18.047387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.047375 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 17:43:18.047441 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.047390 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 17:43:18.047999 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.047975 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbn4" May 27 17:43:18.050452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.050433 2552 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 17:43:18.050756 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.050731 2552 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 17:43:18.050912 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.050900 2552 server.go:1295] "Started kubelet" May 27 17:43:18.051225 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.051189 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 17:43:18.051282 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.051145 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 17:43:18.051322 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.051265 2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 17:43:18.051366 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.051326 2552 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 17:43:18.051580 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.051191 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 17:43:18.052010 ip-10-0-129-78 systemd[1]: Started Kubernetes Kubelet. May 27 17:43:18.052835 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.052821 2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 17:43:18.058602 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.058575 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbn4" May 27 17:43:18.059461 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.059442 2552 server.go:317] "Adding debug handlers to kubelet server" May 27 17:43:18.065104 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.065082 2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 17:43:18.067437 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.067419 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 17:43:18.068143 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068128 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 17:43:18.068421 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068389 2552 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 17:43:18.068421 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068422 2552 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 17:43:18.068546 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068424 2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 17:43:18.068546 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068502 2552 reconstruct.go:97] "Volume reconstruction finished" May 27 17:43:18.068546 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068511 2552 reconciler.go:26] "Reconciler: start to sync state" May 27 17:43:18.068893 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068877 2552 factory.go:55] Registering systemd factory May 27 17:43:18.068973 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.068905 2552 factory.go:223] Registration of the systemd container factory successfully May 27 17:43:18.069137 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069126 2552 factory.go:153] Registering CRI-O factory May 27 17:43:18.069201 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069140 2552 factory.go:223] Registration of the crio container factory successfully May 27 17:43:18.069201 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.069188 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.069305 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069195 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 17:43:18.069305 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069224 2552 factory.go:103] Registering Raw factory May 27 17:43:18.069305 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069247 2552 manager.go:1196] Started watching for new ooms in manager May 27 17:43:18.069958 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.069946 2552 manager.go:319] Starting recovery of all containers May 27 17:43:18.072324 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.072299 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:18.075075 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.074897 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-78.ec2.internal\" not found" node="ip-10-0-129-78.ec2.internal" May 27 17:43:18.080801 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.080674 2552 manager.go:324] Recovery completed May 27 17:43:18.085322 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.085308 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.087401 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087383 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.087492 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087412 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.087492 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087423 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.087975 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087961 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 17:43:18.088012 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087980 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 17:43:18.088012 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.087998 2552 state_mem.go:36] "Initialized new in-memory state store" May 27 17:43:18.091913 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.091901 2552 policy_none.go:49] "None policy: Start" May 27 17:43:18.091955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.091918 2552 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 17:43:18.092533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.092523 2552 state_mem.go:35] "Initializing new in-memory state store" May 27 17:43:18.134242 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134218 2552 manager.go:341] "Starting Device Plugin manager" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.134269 2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134283 2552 server.go:85] "Starting device plugin registration server" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134539 2552 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134550 2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134688 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134794 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.134803 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.135537 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 17:43:18.158457 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.135613 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.204042 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.203961 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 17:43:18.205229 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.205210 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 17:43:18.205327 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.205240 2552 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 17:43:18.205327 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.205265 2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 17:43:18.205327 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.205275 2552 kubelet.go:2451] "Starting kubelet main sync loop" May 27 17:43:18.205451 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.205325 2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 17:43:18.207488 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.207461 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:18.235389 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.235355 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.236353 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.236335 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.236458 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.236367 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.236458 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.236382 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.236458 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.236412 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-78.ec2.internal" May 27 17:43:18.249229 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.249200 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-78.ec2.internal" May 27 17:43:18.249229 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.249228 2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-78.ec2.internal\": node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.267240 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.267205 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.305411 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.305374 2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"] May 27 17:43:18.305489 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.305462 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.306483 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.306466 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.306598 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.306495 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.306598 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.306504 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.307807 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.307795 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.307946 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.307930 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.307986 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.307962 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.308577 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308547 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.308670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308590 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.308670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308600 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.308670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308550 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.308670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308653 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.308670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.308665 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.309842 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.309825 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:18.309892 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.309860 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:18.310822 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.310806 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:18.310905 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.310834 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:18.310905 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.310844 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:18.327225 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.327202 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-78.ec2.internal\" not found" node="ip-10-0-129-78.ec2.internal" May 27 17:43:18.331746 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.331719 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-78.ec2.internal\" not found" node="ip-10-0-129-78.ec2.internal" May 27 17:43:18.368142 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.368104 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.369356 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.369337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.469261 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.469171 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.470319 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.470299 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.470406 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.470338 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.470406 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.470368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949e550394461522a2d1d8947c3eac2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"d949e550394461522a2d1d8947c3eac2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:18.470494 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.470399 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.569887 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.569846 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.570979 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.570958 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.571038 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.570989 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949e550394461522a2d1d8947c3eac2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"d949e550394461522a2d1d8947c3eac2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:18.571038 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.571016 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949e550394461522a2d1d8947c3eac2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"d949e550394461522a2d1d8947c3eac2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:18.571128 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.571060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8fbe5bd59f0905bb98aa61fb22a641-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"1d8fbe5bd59f0905bb98aa61fb22a641\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.630131 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.630101 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:18.634761 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.634733 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:18.670975 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.670941 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.771451 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.771367 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.871857 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.871818 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:18.965141 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.965105 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 17:43:18.965682 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.965306 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:43:18.965682 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:18.965306 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:43:18.972436 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:18.972409 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:19.062887 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.062812 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 17:38:18 +0000 UTC" deadline="2028-01-19 06:35:54.198448363 +0000 UTC" May 27 17:43:19.062887 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.062844 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14436h52m35.135607782s" May 27 17:43:19.067955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.067937 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 17:43:19.073157 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:19.073136 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:19.078847 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.078821 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:43:19.100337 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.100299 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t8mgr" May 27 17:43:19.109755 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.109726 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t8mgr" May 27 17:43:19.173536 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:19.173500 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:19.203271 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:19.203237 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd949e550394461522a2d1d8947c3eac2.slice/crio-0a0b4c0122eb74306180711ce6502536307aef6a8d7a36fb50e9cdc3906f0a59 WatchSource:0}: Error finding container 0a0b4c0122eb74306180711ce6502536307aef6a8d7a36fb50e9cdc3906f0a59: Status 404 returned error can't find the container with id 0a0b4c0122eb74306180711ce6502536307aef6a8d7a36fb50e9cdc3906f0a59 May 27 17:43:19.203526 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:19.203505 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8fbe5bd59f0905bb98aa61fb22a641.slice/crio-4d7338ecbe0205a92566cffbb7bc45b7bcdacce25330fc889c44389c36d79a02 WatchSource:0}: Error finding container 4d7338ecbe0205a92566cffbb7bc45b7bcdacce25330fc889c44389c36d79a02: Status 404 returned error can't find the container with id 4d7338ecbe0205a92566cffbb7bc45b7bcdacce25330fc889c44389c36d79a02 May 27 17:43:19.208860 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.208724 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"1d8fbe5bd59f0905bb98aa61fb22a641","Type":"ContainerStarted","Data":"4d7338ecbe0205a92566cffbb7bc45b7bcdacce25330fc889c44389c36d79a02"} May 27 17:43:19.208987 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.208967 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:43:19.209857 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.209756 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" event={"ID":"d949e550394461522a2d1d8947c3eac2","Type":"ContainerStarted","Data":"0a0b4c0122eb74306180711ce6502536307aef6a8d7a36fb50e9cdc3906f0a59"} May 27 17:43:19.274433 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:19.274380 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found" May 27 17:43:19.292335 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.292313 2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:19.298004 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.297983 2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:19.369433 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.369352 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" May 27 17:43:19.382362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.382331 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:43:19.383542 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.383525 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" May 27 17:43:19.396073 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.396050 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:43:19.958677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.958652 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:19.978491 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:19.978461 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:20.037175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.037129 2552 apiserver.go:52] "Watching apiserver" May 27 17:43:20.049605 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.049573 2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 17:43:20.051978 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.051943 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-cgsrv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x","openshift-cluster-node-tuning-operator/tuned-ltkhv","openshift-image-registry/node-ca-trt7k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-rfg7j","openshift-network-diagnostics/network-check-target-9gbl6","openshift-ovn-kubernetes/ovnkube-node-pdw22","kube-system/konnectivity-agent-fnzts","kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal","openshift-multus/multus-t96s6","openshift-multus/network-metrics-daemon-7nwgk"] May 27 17:43:20.054860 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.054803 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.057606 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.057430 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 17:43:20.057606 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.057448 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 17:43:20.057606 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.057481 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c9xsd\"" May 27 17:43:20.057606 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.057528 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 17:43:20.058966 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.058946 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.061063 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061040 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.061177 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061140 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.061599 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061578 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 17:43:20.061687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061600 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 17:43:20.061687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061656 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 17:43:20.061782 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.061740 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vmfqr\"" May 27 17:43:20.063452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.063431 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.064035 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064017 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 17:43:20.064173 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064155 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 17:43:20.064394 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064376 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x62h\"" May 27 17:43:20.064586 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064571 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 17:43:20.064652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064591 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 17:43:20.064902 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064887 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5dxbp\"" May 27 17:43:20.064974 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.064890 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 17:43:20.065773 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.065753 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 17:43:20.065963 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.065943 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 17:43:20.066031 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.065971 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:20.066091 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.066034 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 17:43:20.066091 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.066039 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:20.066633 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.066420 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tmnzv\"" May 27 17:43:20.066633 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.066459 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 17:43:20.066633 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.066482 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 17:43:20.068199 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.068180 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.071040 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.070969 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.073725 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.073254 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t96s6" May 27 17:43:20.073725 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.073663 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 17:43:20.073886 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.073729 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 17:43:20.073945 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.073927 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 17:43:20.074444 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.074415 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 17:43:20.074662 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.074644 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 17:43:20.074750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.074667 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mbffp\"" May 27 17:43:20.074750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.074698 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wcshr\"" May 27 17:43:20.074943 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.074926 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 17:43:20.075036 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.075020 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 17:43:20.075769 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.075746 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 17:43:20.076392 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.076239 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.077011 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.076881 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:20.077118 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.077099 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 17:43:20.077720 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.077702 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npwsw\"" May 27 17:43:20.080027 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.079897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-systemd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080027 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.079943 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-node-log\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080027 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.079975 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gtvj\" (UniqueName: \"kubernetes.io/projected/99808bb6-3181-43ef-be7f-08de198b103d-kube-api-access-9gtvj\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtw49\" (UniqueName: \"kubernetes.io/projected/989875fe-c5c2-4094-85c8-ca348fd5fe04-kube-api-access-qtw49\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-env-overrides\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-socket-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080198 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-var-lib-kubelet\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-ovn\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-config\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080285 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-sys-fs\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080319 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-modprobe-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080367 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-slash\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279cd058-c22f-4b68-8e72-daf49d220cab-host-slash\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.080861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-kubernetes\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080619 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-tmp\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.080861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080666 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5hx\" (UniqueName: \"kubernetes.io/projected/8e654f21-7f83-4278-b031-3956ca8229d7-kube-api-access-fp5hx\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.080861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080729 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.081634 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.080769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-netns\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.081723 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081674 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43138ba-5f8e-44c8-bc55-8af37266108e-konnectivity-ca\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.081785 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081743 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-sys\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.081837 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-kubelet\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.081837 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081820 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-lib-modules\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.081931 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081851 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f2e298-fad1-49de-ba76-cc0747aeb067-host\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.081931 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmw7k\" (UniqueName: \"kubernetes.io/projected/d62dbec4-8cf6-4361-be58-737d0279933b-kube-api-access-rmw7k\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.082092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081940 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e654f21-7f83-4278-b031-3956ca8229d7-ovn-node-metrics-cert\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081968 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.082092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.081994 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysconfig\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.082092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-bin\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082071 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-script-lib\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082359 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/279cd058-c22f-4b68-8e72-daf49d220cab-iptables-alerter-script\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.082359 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-registration-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.082618 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082597 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-systemd-units\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082693 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-log-socket\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082693 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.082693 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082688 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9lt\" (UniqueName: \"kubernetes.io/projected/279cd058-c22f-4b68-8e72-daf49d220cab-kube-api-access-jv9lt\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43138ba-5f8e-44c8-bc55-8af37266108e-agent-certs\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082733 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-conf\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-run\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082842 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-device-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.082880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082864 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-tuned\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-os-release\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.082984 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-var-lib-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083008 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-etc-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083030 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-host\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62f2e298-fad1-49de-ba76-cc0747aeb067-serviceca\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083123 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-system-cni-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-cnibin\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.083187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.083739 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083192 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-netd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.083739 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4lc7\" (UniqueName: \"kubernetes.io/projected/62f2e298-fad1-49de-ba76-cc0747aeb067-kube-api-access-r4lc7\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.083739 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083256 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-systemd\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.083739 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.083739 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.083303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.110474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.110433 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:19 +0000 UTC" deadline="2028-01-01 01:27:02.876185179 +0000 UTC" May 27 17:43:20.110474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.110464 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h43m42.765725031s" May 27 17:43:20.170348 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.170319 2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 17:43:20.184350 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184311 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-bin\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184363 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-script-lib\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184391 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/279cd058-c22f-4b68-8e72-daf49d220cab-iptables-alerter-script\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184422 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-registration-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184427 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-bin\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184451 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-multus-certs\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.184532 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll27g\" (UniqueName: \"kubernetes.io/projected/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-kube-api-access-ll27g\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184537 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184582 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-systemd-units\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184607 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-log-socket\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184633 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184678 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9lt\" (UniqueName: \"kubernetes.io/projected/279cd058-c22f-4b68-8e72-daf49d220cab-kube-api-access-jv9lt\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184716 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43138ba-5f8e-44c8-bc55-8af37266108e-agent-certs\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184743 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-752k8\" (UniqueName: \"kubernetes.io/projected/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-kube-api-access-752k8\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184774 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-conf\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184798 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-run\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.184855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184828 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184862 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-device-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-os-release\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-etc-kubernetes\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-log-socket\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.184977 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-tuned\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185037 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-os-release\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185055 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-registration-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185068 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185095 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-var-lib-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185119 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-etc-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185164 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185165 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/279cd058-c22f-4b68-8e72-daf49d220cab-iptables-alerter-script\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185209 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cnibin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.185299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185229 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-script-lib\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185346 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-device-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-run\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-kubelet\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185390 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-var-lib-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185400 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185440 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-etc-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185413 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-host\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185457 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-os-release\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185490 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62f2e298-fad1-49de-ba76-cc0747aeb067-serviceca\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-systemd-units\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-system-cni-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185569 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-cnibin\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185595 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-cnibin\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185650 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-conf\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185686 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185739 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-host\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.185957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185791 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-netd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185833 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185799 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-system-cni-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185836 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-openvswitch\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-hostroot\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185902 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-cni-netd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185941 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4lc7\" (UniqueName: \"kubernetes.io/projected/62f2e298-fad1-49de-ba76-cc0747aeb067-kube-api-access-r4lc7\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.185996 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62f2e298-fad1-49de-ba76-cc0747aeb067-serviceca\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186010 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-bin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186063 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186128 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-systemd\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186161 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186194 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-systemd\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-multus\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186348 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-systemd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186377 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-node-log\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.186667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186398 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gtvj\" (UniqueName: \"kubernetes.io/projected/99808bb6-3181-43ef-be7f-08de198b103d-kube-api-access-9gtvj\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186405 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d62dbec4-8cf6-4361-be58-737d0279933b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186419 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtw49\" (UniqueName: \"kubernetes.io/projected/989875fe-c5c2-4094-85c8-ca348fd5fe04-kube-api-access-qtw49\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186459 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-env-overrides\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-node-log\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186599 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-systemd\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186644 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-conf-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186675 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-socket-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186709 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186735 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-var-lib-kubelet\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186771 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-ovn\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186793 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-config\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186831 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysctl-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186854 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-sys-fs\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186864 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-var-lib-kubelet\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cni-binary-copy\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.187391 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186908 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-run-ovn\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186912 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-sys-fs\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186932 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-socket-dir-parent\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186980 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-modprobe-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.186998 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-env-overrides\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187017 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-socket-dir\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187048 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-slash\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187087 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187095 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-modprobe-d\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187091 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-slash\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187153 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187163 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279cd058-c22f-4b68-8e72-daf49d220cab-host-slash\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187195 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-kubernetes\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279cd058-c22f-4b68-8e72-daf49d220cab-host-slash\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187233 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-tmp\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187290 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5hx\" (UniqueName: \"kubernetes.io/projected/8e654f21-7f83-4278-b031-3956ca8229d7-kube-api-access-fp5hx\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187310 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-kubernetes\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188150 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187398 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-system-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187532 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187589 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-netns\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187619 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43138ba-5f8e-44c8-bc55-8af37266108e-konnectivity-ca\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187649 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-k8s-cni-cncf-io\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-daemon-config\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187704 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-sys\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187728 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-kubelet\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187754 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-lib-modules\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187778 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f2e298-fad1-49de-ba76-cc0747aeb067-host\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187802 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmw7k\" (UniqueName: \"kubernetes.io/projected/d62dbec4-8cf6-4361-be58-737d0279933b-kube-api-access-rmw7k\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187831 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e654f21-7f83-4278-b031-3956ca8229d7-ovn-node-metrics-cert\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187879 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187904 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-netns\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.187934 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysconfig\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188032 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-sysconfig\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188092 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-sys\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.188955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188132 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-kubelet\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188139 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e654f21-7f83-4278-b031-3956ca8229d7-ovnkube-config\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188181 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f2e298-fad1-49de-ba76-cc0747aeb067-host\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/989875fe-c5c2-4094-85c8-ca348fd5fe04-lib-modules\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188285 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e654f21-7f83-4278-b031-3956ca8229d7-host-run-netns\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.188357 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99808bb6-3181-43ef-be7f-08de198b103d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.189732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.189393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d62dbec4-8cf6-4361-be58-737d0279933b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.190020 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.189866 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43138ba-5f8e-44c8-bc55-8af37266108e-agent-certs\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.190632 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.190580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-etc-tuned\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.190754 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.190607 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989875fe-c5c2-4094-85c8-ca348fd5fe04-tmp\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.192586 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.192503 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43138ba-5f8e-44c8-bc55-8af37266108e-konnectivity-ca\") pod \"konnectivity-agent-fnzts\" (UID: \"f43138ba-5f8e-44c8-bc55-8af37266108e\") " pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.194498 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.194465 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e654f21-7f83-4278-b031-3956ca8229d7-ovn-node-metrics-cert\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.206646 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.206576 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:20.206646 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.206611 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:20.206646 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.206625 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:20.206899 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.206734 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:20.706709521 +0000 UTC m=+3.143041574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:20.207851 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.207807 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtw49\" (UniqueName: \"kubernetes.io/projected/989875fe-c5c2-4094-85c8-ca348fd5fe04-kube-api-access-qtw49\") pod \"tuned-ltkhv\" (UID: \"989875fe-c5c2-4094-85c8-ca348fd5fe04\") " pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.208922 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.208899 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4lc7\" (UniqueName: \"kubernetes.io/projected/62f2e298-fad1-49de-ba76-cc0747aeb067-kube-api-access-r4lc7\") pod \"node-ca-trt7k\" (UID: \"62f2e298-fad1-49de-ba76-cc0747aeb067\") " pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.213138 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.213105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmw7k\" (UniqueName: \"kubernetes.io/projected/d62dbec4-8cf6-4361-be58-737d0279933b-kube-api-access-rmw7k\") pod \"multus-additional-cni-plugins-rfg7j\" (UID: \"d62dbec4-8cf6-4361-be58-737d0279933b\") " pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.213138 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.213124 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9lt\" (UniqueName: \"kubernetes.io/projected/279cd058-c22f-4b68-8e72-daf49d220cab-kube-api-access-jv9lt\") pod \"iptables-alerter-cgsrv\" (UID: \"279cd058-c22f-4b68-8e72-daf49d220cab\") " pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.213808 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.213787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gtvj\" (UniqueName: \"kubernetes.io/projected/99808bb6-3181-43ef-be7f-08de198b103d-kube-api-access-9gtvj\") pod \"aws-ebs-csi-driver-node-cs48x\" (UID: \"99808bb6-3181-43ef-be7f-08de198b103d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.215239 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.215221 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5hx\" (UniqueName: \"kubernetes.io/projected/8e654f21-7f83-4278-b031-3956ca8229d7-kube-api-access-fp5hx\") pod \"ovnkube-node-pdw22\" (UID: \"8e654f21-7f83-4278-b031-3956ca8229d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.289033 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289002 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-system-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289033 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289038 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-k8s-cni-cncf-io\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289056 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-daemon-config\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289125 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-k8s-cni-cncf-io\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289128 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-system-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289155 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-netns\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289186 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-netns\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289193 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-multus-certs\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289221 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ll27g\" (UniqueName: \"kubernetes.io/projected/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-kube-api-access-ll27g\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289247 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289278 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-752k8\" (UniqueName: \"kubernetes.io/projected/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-kube-api-access-752k8\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-run-multus-certs\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289323 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-os-release\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289347 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-etc-kubernetes\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.289364 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289376 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cnibin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289401 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-kubelet\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.289436 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:20.789418037 +0000 UTC m=+3.225750086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289451 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-etc-kubernetes\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289455 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-kubelet\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cnibin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289504 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-hostroot\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289458 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-os-release\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289530 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-daemon-config\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289541 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-bin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289570 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-hostroot\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.289652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289535 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-cni-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289583 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-multus\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289623 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-multus\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289623 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-conf-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289656 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-conf-dir\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289681 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cni-binary-copy\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289699 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-socket-dir-parent\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289623 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-host-var-lib-cni-bin\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.289822 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-multus-socket-dir-parent\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.290188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.290018 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-cni-binary-copy\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.303706 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.303680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll27g\" (UniqueName: \"kubernetes.io/projected/b20d8ac3-7485-4b11-b53b-c9c2b06413c3-kube-api-access-ll27g\") pod \"multus-t96s6\" (UID: \"b20d8ac3-7485-4b11-b53b-c9c2b06413c3\") " pod="openshift-multus/multus-t96s6" May 27 17:43:20.304278 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.304250 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-752k8\" (UniqueName: \"kubernetes.io/projected/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-kube-api-access-752k8\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.368199 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.368165 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgsrv" May 27 17:43:20.377240 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.377213 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" May 27 17:43:20.392034 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.392002 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" May 27 17:43:20.397568 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.397525 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-trt7k" May 27 17:43:20.405237 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.405207 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" May 27 17:43:20.412983 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.412959 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:20.421704 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.421678 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:20.428459 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.428433 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t96s6" May 27 17:43:20.792021 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.791987 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:20.792181 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:20.792029 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:20.792181 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792138 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:20.792260 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792209 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:21.792192767 +0000 UTC m=+4.228524803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:20.792260 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792143 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:20.792260 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792238 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:20.792260 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792248 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:20.792423 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:20.792292 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:21.792281555 +0000 UTC m=+4.228613586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:20.826087 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.826058 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20d8ac3_7485_4b11_b53b_c9c2b06413c3.slice/crio-1fba798db7cb561b6081932853215e23cf019931bb91aab1393df236cedbec84 WatchSource:0}: Error finding container 1fba798db7cb561b6081932853215e23cf019931bb91aab1393df236cedbec84: Status 404 returned error can't find the container with id 1fba798db7cb561b6081932853215e23cf019931bb91aab1393df236cedbec84 May 27 17:43:20.828241 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.828214 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e654f21_7f83_4278_b031_3956ca8229d7.slice/crio-5ac36341c172240d0a801e524cafefc37da701bb5db10ff53f912349fcf98aeb WatchSource:0}: Error finding container 5ac36341c172240d0a801e524cafefc37da701bb5db10ff53f912349fcf98aeb: Status 404 returned error can't find the container with id 5ac36341c172240d0a801e524cafefc37da701bb5db10ff53f912349fcf98aeb May 27 17:43:20.830841 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.830795 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f2e298_fad1_49de_ba76_cc0747aeb067.slice/crio-ab8bee6f0cbd7e8d69cd4664c32583e6ddf46daa5feb22962250163dd056448e WatchSource:0}: Error finding container ab8bee6f0cbd7e8d69cd4664c32583e6ddf46daa5feb22962250163dd056448e: Status 404 returned error can't find the container with id ab8bee6f0cbd7e8d69cd4664c32583e6ddf46daa5feb22962250163dd056448e May 27 17:43:20.832016 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.831902 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43138ba_5f8e_44c8_bc55_8af37266108e.slice/crio-292e398bf22eb25db5832df19004ea2507e5f3b6beab57a2f168c5fdfd0714c7 WatchSource:0}: Error finding container 292e398bf22eb25db5832df19004ea2507e5f3b6beab57a2f168c5fdfd0714c7: Status 404 returned error can't find the container with id 292e398bf22eb25db5832df19004ea2507e5f3b6beab57a2f168c5fdfd0714c7 May 27 17:43:20.832832 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.832808 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279cd058_c22f_4b68_8e72_daf49d220cab.slice/crio-ced25757ced89e32fd841c1e9f3151f9eb9d6db92fbca9081fd31a448dd243d6 WatchSource:0}: Error finding container ced25757ced89e32fd841c1e9f3151f9eb9d6db92fbca9081fd31a448dd243d6: Status 404 returned error can't find the container with id ced25757ced89e32fd841c1e9f3151f9eb9d6db92fbca9081fd31a448dd243d6 May 27 17:43:20.833676 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.833641 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99808bb6_3181_43ef_be7f_08de198b103d.slice/crio-67ce46a7d3ccbe4a9fe713b06124528cdb6a299dc7df4842a98faf4f7100192e WatchSource:0}: Error finding container 67ce46a7d3ccbe4a9fe713b06124528cdb6a299dc7df4842a98faf4f7100192e: Status 404 returned error can't find the container with id 67ce46a7d3ccbe4a9fe713b06124528cdb6a299dc7df4842a98faf4f7100192e May 27 17:43:20.834632 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.834546 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989875fe_c5c2_4094_85c8_ca348fd5fe04.slice/crio-11c7ef6b175398c2efe616df2012838dc60abdf4328ecf4eb560e42f5167f910 WatchSource:0}: Error finding container 11c7ef6b175398c2efe616df2012838dc60abdf4328ecf4eb560e42f5167f910: Status 404 returned error can't find the container with id 11c7ef6b175398c2efe616df2012838dc60abdf4328ecf4eb560e42f5167f910 May 27 17:43:20.836735 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:20.836586 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62dbec4_8cf6_4361_be58_737d0279933b.slice/crio-6a1c2e3c595ebf06f95b807ecc60fb905c0aca3bcf649cc9a1d6ea9902ee8da7 WatchSource:0}: Error finding container 6a1c2e3c595ebf06f95b807ecc60fb905c0aca3bcf649cc9a1d6ea9902ee8da7: Status 404 returned error can't find the container with id 6a1c2e3c595ebf06f95b807ecc60fb905c0aca3bcf649cc9a1d6ea9902ee8da7 May 27 17:43:21.111364 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.111183 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:19 +0000 UTC" deadline="2027-11-09 17:35:54.910331176 +0000 UTC" May 27 17:43:21.111364 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.111362 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12743h52m33.798973274s" May 27 17:43:21.215831 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.215691 2552 generic.go:358] "Generic (PLEG): container finished" podID="1d8fbe5bd59f0905bb98aa61fb22a641" containerID="a81c993bdedccc579fd7cc5e1d9d8f2c5f9c37ad7932f4f78f907291c447dd47" exitCode=0 May 27 17:43:21.215831 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.215791 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"1d8fbe5bd59f0905bb98aa61fb22a641","Type":"ContainerDied","Data":"a81c993bdedccc579fd7cc5e1d9d8f2c5f9c37ad7932f4f78f907291c447dd47"} May 27 17:43:21.223227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.222959 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" event={"ID":"d949e550394461522a2d1d8947c3eac2","Type":"ContainerStarted","Data":"d79bf8bfd633494d0801f71afcfdeb3510bae8775691a806ab56b2175b8e3a15"} May 27 17:43:21.226708 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.225684 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" event={"ID":"989875fe-c5c2-4094-85c8-ca348fd5fe04","Type":"ContainerStarted","Data":"11c7ef6b175398c2efe616df2012838dc60abdf4328ecf4eb560e42f5167f910"} May 27 17:43:21.227693 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.227659 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"5ac36341c172240d0a801e524cafefc37da701bb5db10ff53f912349fcf98aeb"} May 27 17:43:21.229700 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.229672 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t96s6" event={"ID":"b20d8ac3-7485-4b11-b53b-c9c2b06413c3","Type":"ContainerStarted","Data":"1fba798db7cb561b6081932853215e23cf019931bb91aab1393df236cedbec84"} May 27 17:43:21.231066 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.231036 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerStarted","Data":"6a1c2e3c595ebf06f95b807ecc60fb905c0aca3bcf649cc9a1d6ea9902ee8da7"} May 27 17:43:21.233344 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.233319 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" event={"ID":"99808bb6-3181-43ef-be7f-08de198b103d","Type":"ContainerStarted","Data":"67ce46a7d3ccbe4a9fe713b06124528cdb6a299dc7df4842a98faf4f7100192e"} May 27 17:43:21.235696 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.235675 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgsrv" event={"ID":"279cd058-c22f-4b68-8e72-daf49d220cab","Type":"ContainerStarted","Data":"ced25757ced89e32fd841c1e9f3151f9eb9d6db92fbca9081fd31a448dd243d6"} May 27 17:43:21.237023 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.236979 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnzts" event={"ID":"f43138ba-5f8e-44c8-bc55-8af37266108e","Type":"ContainerStarted","Data":"292e398bf22eb25db5832df19004ea2507e5f3b6beab57a2f168c5fdfd0714c7"} May 27 17:43:21.238137 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.238116 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-trt7k" event={"ID":"62f2e298-fad1-49de-ba76-cc0747aeb067","Type":"ContainerStarted","Data":"ab8bee6f0cbd7e8d69cd4664c32583e6ddf46daa5feb22962250163dd056448e"} May 27 17:43:21.251725 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.251671 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" podStartSLOduration=2.251651982 podStartE2EDuration="2.251651982s" podCreationTimestamp="2026-05-27 17:43:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:21.250960076 +0000 UTC m=+3.687292127" watchObservedRunningTime="2026-05-27 17:43:21.251651982 +0000 UTC m=+3.687984036" May 27 17:43:21.799585 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.799475 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:21.799585 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:21.799535 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:21.799829 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.799720 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:21.799829 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.799738 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:21.799829 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.799753 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:21.799829 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.799813 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:23.799794218 +0000 UTC m=+6.236126261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:21.800374 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.800240 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:21.800374 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:21.800294 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:23.800278941 +0000 UTC m=+6.236610980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:22.208148 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:22.208054 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:22.208615 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:22.208201 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:22.208692 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:22.208622 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:22.208742 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:22.208708 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:22.264647 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:22.264104 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"1d8fbe5bd59f0905bb98aa61fb22a641","Type":"ContainerStarted","Data":"22a8447481078c41251e22753fe26654e2e807a1576e16f40cb9b223100072c4"} May 27 17:43:23.818013 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:23.817973 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:23.818467 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:23.818064 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:23.818467 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818189 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:23.818467 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818254 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:27.81823342 +0000 UTC m=+10.254565451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:23.818753 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818725 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:23.818824 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818760 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:23.818824 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818776 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:23.818977 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:23.818837 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:27.818818819 +0000 UTC m=+10.255150865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:24.207476 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:24.207393 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:24.208020 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:24.207648 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:24.208020 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:24.207691 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:24.208020 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:24.207824 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:26.205897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:26.205854 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:26.205897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:26.205886 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:26.206409 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:26.205991 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:26.206409 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:26.206097 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:27.853282 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:27.853239 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:27.853859 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:27.853298 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:27.853859 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.853482 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:27.853859 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.853501 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:27.853859 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.853514 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:27.853859 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.853592 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:35.853572088 +0000 UTC m=+18.289904133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:27.854213 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.854010 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:27.854213 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:27.854063 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:35.854046706 +0000 UTC m=+18.290378741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:28.207354 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:28.207270 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:28.207514 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:28.207406 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:28.207514 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:28.207462 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:28.207630 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:28.207545 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:30.205776 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:30.205734 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:30.205776 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:30.205758 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:30.206287 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:30.205895 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:30.206287 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:30.206012 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:31.407184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.407129 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" podStartSLOduration=12.407112109 podStartE2EDuration="12.407112109s" podCreationTimestamp="2026-05-27 17:43:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:22.2791479 +0000 UTC m=+4.715479952" watchObservedRunningTime="2026-05-27 17:43:31.407112109 +0000 UTC m=+13.843444161" May 27 17:43:31.407690 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.407542 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g952z"] May 27 17:43:31.436946 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.436919 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.437092 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:31.437002 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:31.483461 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.483434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-dbus\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.483648 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.483468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.483648 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.483541 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-kubelet-config\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584085 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.584055 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-dbus\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584085 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.584092 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.584158 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-kubelet-config\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.584225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-kubelet-config\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:31.584269 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f02c97f8-6d99-4232-adff-ee0f8297efc7-dbus\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:31.584486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:31.584292 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:31.584486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:31.584364 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:32.08434036 +0000 UTC m=+14.520672405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:32.086689 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:32.086651 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:32.086887 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:32.086810 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:32.086887 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:32.086885 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:33.086864793 +0000 UTC m=+15.523196840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:32.206221 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:32.206191 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:32.206394 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:32.206224 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:32.206394 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:32.206339 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:32.206503 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:32.206472 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:33.092896 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:33.092862 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:33.093254 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:33.093031 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:33.093254 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:33.093114 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:35.093096862 +0000 UTC m=+17.529428892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:33.205598 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:33.205573 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:33.205769 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:33.205684 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:34.206316 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:34.206278 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:34.206316 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:34.206317 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:34.206790 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:34.206737 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:34.209248 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:34.207301 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:35.106650 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:35.106611 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:35.106869 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.106780 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:35.106869 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.106865 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:39.106842849 +0000 UTC m=+21.543174898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:35.205953 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:35.205919 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:35.206117 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.206028 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:35.912230 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:35.912188 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:35.912247 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912352 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912382 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912397 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912410 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912431 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.912411679 +0000 UTC m=+34.348743713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:35.912647 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:35.912459 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.912444229 +0000 UTC m=+34.348776262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:36.205610 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:36.205513 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:36.205770 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:36.205513 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:36.205770 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:36.205665 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:36.205770 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:36.205745 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:37.205998 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:37.205960 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:37.206412 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:37.206090 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:38.208962 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:38.206308 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:38.208962 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:38.206427 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:38.208962 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:38.206776 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:38.208962 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:38.207521 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:39.136526 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.136100 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:39.136641 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:39.136238 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:39.136683 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:39.136665 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.136642517 +0000 UTC m=+29.572974592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:39.205923 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.205893 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:39.206054 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:39.205983 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:39.295965 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.295932 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" event={"ID":"989875fe-c5c2-4094-85c8-ca348fd5fe04","Type":"ContainerStarted","Data":"9e7e6160a4a56c7a2754cb9996a3b125991b3fca899b27b14e396c013cea2d16"} May 27 17:43:39.300604 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.300579 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"4b4a71b0691e292c65d52b46290d6667cf8950af436a65c576dd1d8f364272e0"} May 27 17:43:39.300711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.300609 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"b43bfec9822b8ecee5cdd6b6343e66f15decb44598f71303d252044e531c7852"} May 27 17:43:39.300711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.300619 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"e4dccd86e0ac736dec5931f1c69a1cd63c2a0f7061cbbe25bf79ebf9dab27280"} May 27 17:43:39.300711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.300629 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"08ea20341f5909f3adcf8d8d7777f97e26066ed322fddccc603927ba95dbfc90"} May 27 17:43:39.300711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.300640 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"f9390c1634ecf3a9d32fd45f272de03d52d409055cbe17aca8083bda55405b83"} May 27 17:43:39.301828 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.301804 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t96s6" event={"ID":"b20d8ac3-7485-4b11-b53b-c9c2b06413c3","Type":"ContainerStarted","Data":"b23b118937e3f55ee13e2365202d330ae0667eaa1b55ccaefcaa21df321c5636"} May 27 17:43:39.303034 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.303011 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="d1801478d5e0dec3c8e3fae9277e31fcd03809fcfa30421201fe9c695dfb6ad9" exitCode=0 May 27 17:43:39.303097 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.303061 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"d1801478d5e0dec3c8e3fae9277e31fcd03809fcfa30421201fe9c695dfb6ad9"} May 27 17:43:39.304354 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.304335 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" event={"ID":"99808bb6-3181-43ef-be7f-08de198b103d","Type":"ContainerStarted","Data":"ffaff39f02ebf6c64890767a075bc75d4ef70923da70448ce59b4f7d982b2631"} May 27 17:43:39.305399 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.305380 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnzts" event={"ID":"f43138ba-5f8e-44c8-bc55-8af37266108e","Type":"ContainerStarted","Data":"88ef1a617f3209c6aaed8fb2872dc05fd728a19091a8e1814efd000009afc9fc"} May 27 17:43:39.306485 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.306462 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-trt7k" event={"ID":"62f2e298-fad1-49de-ba76-cc0747aeb067","Type":"ContainerStarted","Data":"7316ae7933bded41c7a57ed53bfb79544029e300213302c8986aac13c997e7c3"} May 27 17:43:39.316136 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.316085 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ltkhv" podStartSLOduration=3.425502316 podStartE2EDuration="21.316045344s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.836997984 +0000 UTC m=+3.273330033" lastFinishedPulling="2026-05-27 17:43:38.727541023 +0000 UTC m=+21.163873061" observedRunningTime="2026-05-27 17:43:39.315753032 +0000 UTC m=+21.752085084" watchObservedRunningTime="2026-05-27 17:43:39.316045344 +0000 UTC m=+21.752377396" May 27 17:43:39.354600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.354537 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnzts" podStartSLOduration=3.507259654 podStartE2EDuration="21.354521858s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.833983839 +0000 UTC m=+3.270315883" lastFinishedPulling="2026-05-27 17:43:38.681246041 +0000 UTC m=+21.117578087" observedRunningTime="2026-05-27 17:43:39.354168357 +0000 UTC m=+21.790500410" watchObservedRunningTime="2026-05-27 17:43:39.354521858 +0000 UTC m=+21.790853906" May 27 17:43:39.373280 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.373242 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t96s6" podStartSLOduration=3.472687798 podStartE2EDuration="21.373228236s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.829126226 +0000 UTC m=+3.265458256" lastFinishedPulling="2026-05-27 17:43:38.729666654 +0000 UTC m=+21.165998694" observedRunningTime="2026-05-27 17:43:39.37278747 +0000 UTC m=+21.809119551" watchObservedRunningTime="2026-05-27 17:43:39.373228236 +0000 UTC m=+21.809560288" May 27 17:43:39.392621 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:39.392586 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-trt7k" podStartSLOduration=3.544226658 podStartE2EDuration="21.392573959s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.832901707 +0000 UTC m=+3.269233737" lastFinishedPulling="2026-05-27 17:43:38.681248991 +0000 UTC m=+21.117581038" observedRunningTime="2026-05-27 17:43:39.392335397 +0000 UTC m=+21.828667449" watchObservedRunningTime="2026-05-27 17:43:39.392573959 +0000 UTC m=+21.828906005" May 27 17:43:40.126780 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.126748 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 17:43:40.145631 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.145523 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:43:40.126779162Z","UUID":"c8205fb1-66e2-4604-b3f0-e81385cc7f90","Handler":null,"Name":"","Endpoint":""} May 27 17:43:40.148078 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.148057 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 17:43:40.148178 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.148087 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 17:43:40.206502 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.206468 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:40.206696 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.206509 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:40.206696 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:40.206628 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:40.206819 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:40.206707 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:40.312023 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.311981 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"58d3ff9cad4a7dbc41bd3de9dd462225804ae21d270363ab1b6b9653db2cd5b1"} May 27 17:43:40.313676 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.313644 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" event={"ID":"99808bb6-3181-43ef-be7f-08de198b103d","Type":"ContainerStarted","Data":"07df91fe99f54777a79b2751600a824cfe65afdbaaa8aee1d3c4fec296a108ea"} May 27 17:43:40.315074 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.315013 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgsrv" event={"ID":"279cd058-c22f-4b68-8e72-daf49d220cab","Type":"ContainerStarted","Data":"174be42b7243d789e7bdf41c154abdd8d803a4606abfa6234630ad95b100f42d"} May 27 17:43:40.333228 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.333178 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cgsrv" podStartSLOduration=4.439163254 podStartE2EDuration="22.333163697s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.835125227 +0000 UTC m=+3.271457271" lastFinishedPulling="2026-05-27 17:43:38.729125668 +0000 UTC m=+21.165457714" observedRunningTime="2026-05-27 17:43:40.332977247 +0000 UTC m=+22.769309298" watchObservedRunningTime="2026-05-27 17:43:40.333163697 +0000 UTC m=+22.769495808" May 27 17:43:40.673848 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.673816 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:40.674640 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:40.674583 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:41.205864 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:41.205830 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:41.206035 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:41.205958 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:41.317261 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:41.317234 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:41.317656 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:41.317346 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnzts" May 27 17:43:42.206281 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:42.206247 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:42.206281 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:42.206269 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:42.206525 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:42.206382 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:42.206607 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:42.206506 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:42.321613 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:42.321574 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"52d6613bb4aeeb9c5aa2f1f5c4b0d0f481ac207b0cb96f76d7addf2fa54701f4"} May 27 17:43:42.323623 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:42.323596 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" event={"ID":"99808bb6-3181-43ef-be7f-08de198b103d","Type":"ContainerStarted","Data":"c353d36d44f34d53999b2f01552887a891a1494180a5c75de20f1e0a75b06af0"} May 27 17:43:43.206461 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.206431 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:43.206635 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:43.206540 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:43.710958 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.710820 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cs48x" podStartSLOduration=5.287997305 podStartE2EDuration="25.710805437s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.835778562 +0000 UTC m=+3.272110611" lastFinishedPulling="2026-05-27 17:43:41.258586698 +0000 UTC m=+23.694918743" observedRunningTime="2026-05-27 17:43:42.34872921 +0000 UTC m=+24.785061262" watchObservedRunningTime="2026-05-27 17:43:43.710805437 +0000 UTC m=+26.147137510" May 27 17:43:43.711600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.711585 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-lbbg7"] May 27 17:43:43.714928 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.714908 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.717234 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.717187 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 17:43:43.717361 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.717250 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 17:43:43.717488 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.717474 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nw96n\"" May 27 17:43:43.775401 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.775027 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6w6k\" (UniqueName: \"kubernetes.io/projected/e12677bd-7bd2-485c-93ff-47998853b2fa-kube-api-access-v6w6k\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.775401 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.775078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e12677bd-7bd2-485c-93ff-47998853b2fa-hosts-file\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.775401 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.775098 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12677bd-7bd2-485c-93ff-47998853b2fa-tmp-dir\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.875603 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.875577 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6w6k\" (UniqueName: \"kubernetes.io/projected/e12677bd-7bd2-485c-93ff-47998853b2fa-kube-api-access-v6w6k\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.875743 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.875627 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e12677bd-7bd2-485c-93ff-47998853b2fa-hosts-file\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.875743 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.875644 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12677bd-7bd2-485c-93ff-47998853b2fa-tmp-dir\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.875855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.875767 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e12677bd-7bd2-485c-93ff-47998853b2fa-hosts-file\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.875915 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.875900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12677bd-7bd2-485c-93ff-47998853b2fa-tmp-dir\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:43.888047 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:43.887861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6w6k\" (UniqueName: \"kubernetes.io/projected/e12677bd-7bd2-485c-93ff-47998853b2fa-kube-api-access-v6w6k\") pod \"node-resolver-lbbg7\" (UID: \"e12677bd-7bd2-485c-93ff-47998853b2fa\") " pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:44.023103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.023037 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbbg7" May 27 17:43:44.031032 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:43:44.031005 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12677bd_7bd2_485c_93ff_47998853b2fa.slice/crio-8f691ed5dc24028cc4ba9afd6c0c4adcc490269fe40f9008013fe383d9038515 WatchSource:0}: Error finding container 8f691ed5dc24028cc4ba9afd6c0c4adcc490269fe40f9008013fe383d9038515: Status 404 returned error can't find the container with id 8f691ed5dc24028cc4ba9afd6c0c4adcc490269fe40f9008013fe383d9038515 May 27 17:43:44.206067 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.206035 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:44.206202 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.206048 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:44.206267 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:44.206246 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:44.206309 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:44.206130 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:44.329650 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.329525 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" event={"ID":"8e654f21-7f83-4278-b031-3956ca8229d7","Type":"ContainerStarted","Data":"6caef8cce8b62353567806ad4746570fb5a41b66a157944c9ed51a9e5fe2f2ca"} May 27 17:43:44.329846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.329823 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:44.329961 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.329857 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:44.330962 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.330938 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbbg7" event={"ID":"e12677bd-7bd2-485c-93ff-47998853b2fa","Type":"ContainerStarted","Data":"60fae5f190aed833827cbd6cc53bb21a4012ab28068de3f1b357a244110cc882"} May 27 17:43:44.331055 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.330972 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbbg7" event={"ID":"e12677bd-7bd2-485c-93ff-47998853b2fa","Type":"ContainerStarted","Data":"8f691ed5dc24028cc4ba9afd6c0c4adcc490269fe40f9008013fe383d9038515"} May 27 17:43:44.332641 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.332615 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="eee40c1e05de01d6e66afc87ad0a768c5becf35819219e9e297dfbbf31008008" exitCode=0 May 27 17:43:44.332733 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.332660 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"eee40c1e05de01d6e66afc87ad0a768c5becf35819219e9e297dfbbf31008008"} May 27 17:43:44.345268 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.345249 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:44.345647 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.345631 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:44.359500 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.359443 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" podStartSLOduration=8.330166607 podStartE2EDuration="26.359426705s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.830185831 +0000 UTC m=+3.266517875" lastFinishedPulling="2026-05-27 17:43:38.859445929 +0000 UTC m=+21.295777973" observedRunningTime="2026-05-27 17:43:44.358226608 +0000 UTC m=+26.794558653" watchObservedRunningTime="2026-05-27 17:43:44.359426705 +0000 UTC m=+26.795758761" May 27 17:43:44.424711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:44.424668 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lbbg7" podStartSLOduration=1.4246560750000001 podStartE2EDuration="1.424656075s" podCreationTimestamp="2026-05-27 17:43:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:44.424320843 +0000 UTC m=+26.860652895" watchObservedRunningTime="2026-05-27 17:43:44.424656075 +0000 UTC m=+26.860988126" May 27 17:43:45.205885 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.205864 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:45.206268 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:45.205959 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:45.336005 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.335973 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerStarted","Data":"ca785b9c0e9e8048de24d6695b3aa748071ddcc0fe5027d8a1055a4fdfd78619"} May 27 17:43:45.336215 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.336198 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 17:43:45.991541 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.991510 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7nwgk"] May 27 17:43:45.991714 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.991668 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:45.991807 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:45.991785 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:45.993994 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.993969 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gbl6"] May 27 17:43:45.994115 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:45.994076 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:45.994156 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:45.994146 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:46.003187 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:46.003164 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g952z"] May 27 17:43:46.003263 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:46.003237 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:46.003324 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:46.003307 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:46.339427 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:46.339393 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="ca785b9c0e9e8048de24d6695b3aa748071ddcc0fe5027d8a1055a4fdfd78619" exitCode=0 May 27 17:43:46.339898 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:46.339483 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"ca785b9c0e9e8048de24d6695b3aa748071ddcc0fe5027d8a1055a4fdfd78619"} May 27 17:43:46.339898 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:46.339665 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 17:43:47.203685 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.203491 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:47.203807 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:47.203658 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 17:43:47.203807 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:47.203748 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret podName:f02c97f8-6d99-4232-adff-ee0f8297efc7 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:03.203731718 +0000 UTC m=+45.640063748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret") pod "global-pull-secret-syncer-g952z" (UID: "f02c97f8-6d99-4232-adff-ee0f8297efc7") : object "kube-system"/"original-pull-secret" not registered May 27 17:43:47.205491 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.205469 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:47.205567 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.205505 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:47.205567 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.205503 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:47.205800 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:47.205605 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:47.205800 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:47.205671 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:47.205800 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:47.205723 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:47.343658 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.343577 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="6c25a1637b3d88137aef3009f399d24927988effc2095e1100fde497153a5d0c" exitCode=0 May 27 17:43:47.343658 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:47.343636 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"6c25a1637b3d88137aef3009f399d24927988effc2095e1100fde497153a5d0c"} May 27 17:43:49.193777 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.193745 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:43:49.194473 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.193998 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 17:43:49.206247 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.206228 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:49.206365 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.206255 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:49.206365 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.206296 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:49.206478 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:49.206387 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:49.206550 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:49.206528 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:49.206681 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:49.206657 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:49.213453 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.213417 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" podUID="8e654f21-7f83-4278-b031-3956ca8229d7" containerName="ovnkube-controller" probeResult="failure" output="" May 27 17:43:49.223277 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:49.223245 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" podUID="8e654f21-7f83-4278-b031-3956ca8229d7" containerName="ovnkube-controller" probeResult="failure" output="" May 27 17:43:51.206203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.206165 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:51.206203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.206203 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:51.206874 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.206165 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:51.206874 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.206299 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g952z" podUID="f02c97f8-6d99-4232-adff-ee0f8297efc7" May 27 17:43:51.206874 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.206399 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7nwgk" podUID="d2a39535-6a8b-4f87-9f0b-65535fe15f3d" May 27 17:43:51.206874 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.206489 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbl6" podUID="52cf2a63-1cda-44ec-82f7-fcbf484fb66a" May 27 17:43:51.391550 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.391518 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeReady" May 27 17:43:51.391807 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.391672 2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 17:43:51.428572 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.428525 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:43:51.470192 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.470117 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qml4g"] May 27 17:43:51.470344 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.470229 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.472900 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.472875 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 17:43:51.472900 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.472888 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp774\"" May 27 17:43:51.473101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.472990 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 17:43:51.473216 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.473201 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 17:43:51.477873 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.477848 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 17:43:51.486116 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.486091 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vpvtv"] May 27 17:43:51.486256 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.486242 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.488670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.488653 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 17:43:51.488778 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.488678 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv9xv\"" May 27 17:43:51.488778 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.488652 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 17:43:51.504300 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.504273 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:43:51.504420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.504311 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qml4g"] May 27 17:43:51.504420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.504323 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpvtv"] May 27 17:43:51.504420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.504358 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.506803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.506784 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 17:43:51.506929 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.506782 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prtm9\"" May 27 17:43:51.506993 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.506958 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 17:43:51.507208 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.507191 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 17:43:51.636105 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636125 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636179 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01738e52-7941-4f85-bfe9-5a98bb5560a8-tmp-dir\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636229 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkqz\" (UniqueName: \"kubernetes.io/projected/01620d2b-48aa-444d-a92f-9014fe394cd6-kube-api-access-qjkqz\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.636295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfcv5\" (UniqueName: \"kubernetes.io/projected/01738e52-7941-4f85-bfe9-5a98bb5560a8-kube-api-access-sfcv5\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636417 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzgr\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636519 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01738e52-7941-4f85-bfe9-5a98bb5560a8-config-volume\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636545 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.636608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.636591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737461 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737369 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfcv5\" (UniqueName: \"kubernetes.io/projected/01738e52-7941-4f85-bfe9-5a98bb5560a8-kube-api-access-sfcv5\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.737461 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737448 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737478 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737507 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzgr\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737585 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737635 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01738e52-7941-4f85-bfe9-5a98bb5560a8-config-volume\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737669 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737696 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.737726 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.737789 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:52.237770569 +0000 UTC m=+34.674102606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.737834 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.737851 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737917 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.737980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737925 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.737988 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738014 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.738033 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:43:52.238017945 +0000 UTC m=+34.674349975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738072 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01738e52-7941-4f85-bfe9-5a98bb5560a8-tmp-dir\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738099 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738124 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkqz\" (UniqueName: \"kubernetes.io/projected/01620d2b-48aa-444d-a92f-9014fe394cd6-kube-api-access-qjkqz\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.738287 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738270 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01738e52-7941-4f85-bfe9-5a98bb5560a8-config-volume\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.738660 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.738316 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:43:51.738660 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.738372 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:52.238356668 +0000 UTC m=+34.674688700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:43:51.738660 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.738660 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738485 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01738e52-7941-4f85-bfe9-5a98bb5560a8-tmp-dir\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.738897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.738879 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.742073 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.742053 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.742073 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.742064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.746997 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.746957 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.747382 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.747276 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkqz\" (UniqueName: \"kubernetes.io/projected/01620d2b-48aa-444d-a92f-9014fe394cd6-kube-api-access-qjkqz\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:51.747870 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.747828 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzgr\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:51.748071 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.748022 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfcv5\" (UniqueName: \"kubernetes.io/projected/01738e52-7941-4f85-bfe9-5a98bb5560a8-kube-api-access-sfcv5\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:51.940435 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.940398 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:51.940626 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:51.940447 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:51.940626 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940541 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:51.940737 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940628 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:51.940737 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940640 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs podName:d2a39535-6a8b-4f87-9f0b-65535fe15f3d nodeName:}" failed. No retries permitted until 2026-05-27 17:44:23.940623815 +0000 UTC m=+66.376955851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs") pod "network-metrics-daemon-7nwgk" (UID: "d2a39535-6a8b-4f87-9f0b-65535fe15f3d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:51.940737 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940643 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:51.940737 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940658 2552 projected.go:194] Error preparing data for projected volume kube-api-access-vwnv2 for pod openshift-network-diagnostics/network-check-target-9gbl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:51.940737 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:51.940720 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2 podName:52cf2a63-1cda-44ec-82f7-fcbf484fb66a nodeName:}" failed. No retries permitted until 2026-05-27 17:44:23.94070443 +0000 UTC m=+66.377036476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwnv2" (UniqueName: "kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2") pod "network-check-target-9gbl6" (UID: "52cf2a63-1cda-44ec-82f7-fcbf484fb66a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:52.242759 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:52.242705 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.242872 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.242942 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:53.24292258 +0000 UTC m=+35.679254621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:52.242875 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.242950 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.242967 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.243018 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:43:53.243002463 +0000 UTC m=+35.679334498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:52.243057 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.243136 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:43:52.243335 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:52.243179 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:53.243165023 +0000 UTC m=+35.679497054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:43:53.205948 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.205918 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:43:53.206101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.205961 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:43:53.206101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.206044 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:43:53.211260 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211213 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frs9q\"" May 27 17:43:53.211260 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211213 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 17:43:53.211260 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211211 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 17:43:53.211796 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211779 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 17:43:53.211881 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211816 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 17:43:53.211952 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.211939 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\"" May 27 17:43:53.252523 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.252503 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.252547 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252650 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252661 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252676 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252702 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:43:55.252686843 +0000 UTC m=+37.689018872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:53.252782 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252790 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:55.252771682 +0000 UTC m=+37.689103728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:43:53.252880 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252850 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:43:53.253146 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:53.252905 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:55.252891548 +0000 UTC m=+37.689223594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:43:54.360500 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:54.360471 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="8e559f31281418d036d9afa686bea334bc63657d464679a692f1229d38bfb50b" exitCode=0 May 27 17:43:54.360909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:54.360531 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"8e559f31281418d036d9afa686bea334bc63657d464679a692f1229d38bfb50b"} May 27 17:43:55.267106 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:55.267069 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:55.267297 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:55.267123 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:55.267297 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:55.267165 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:55.267297 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267244 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:43:55.267297 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267271 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:43:55.267297 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267288 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:43:55.267486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267251 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:43:55.267486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267326 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.267306387 +0000 UTC m=+41.703638416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:43:55.267486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267346 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.267336307 +0000 UTC m=+41.703668338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:43:55.267486 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:55.267362 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.267353695 +0000 UTC m=+41.703685732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:43:55.368147 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:55.368118 2552 generic.go:358] "Generic (PLEG): container finished" podID="d62dbec4-8cf6-4361-be58-737d0279933b" containerID="e98fc48cf6e21526498a61cae3ee294d621dc692597a2da375ad577d877ea75d" exitCode=0 May 27 17:43:55.368502 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:55.368187 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerDied","Data":"e98fc48cf6e21526498a61cae3ee294d621dc692597a2da375ad577d877ea75d"} May 27 17:43:56.372760 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:56.372725 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" event={"ID":"d62dbec4-8cf6-4361-be58-737d0279933b","Type":"ContainerStarted","Data":"2263548103ab61dddca7a7d536a22d15c8cedf9054f816ec3b8b6f73b65a01e5"} May 27 17:43:56.398686 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:56.398636 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rfg7j" podStartSLOduration=5.966624273 podStartE2EDuration="38.398622518s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:20.840148831 +0000 UTC m=+3.276480876" lastFinishedPulling="2026-05-27 17:43:53.272147092 +0000 UTC m=+35.708479121" observedRunningTime="2026-05-27 17:43:56.39731662 +0000 UTC m=+38.833648683" watchObservedRunningTime="2026-05-27 17:43:56.398622518 +0000 UTC m=+38.834954570" May 27 17:43:59.297241 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:59.297199 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:59.297260 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297349 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297364 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:43:59.297393 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297417 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:07.297400435 +0000 UTC m=+49.733732466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297446 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:07.297438423 +0000 UTC m=+49.733770453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297474 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297487 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:43:59.297685 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:43:59.297540 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:44:07.297524049 +0000 UTC m=+49.733856080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:44:00.370977 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.370947 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm"] May 27 17:44:00.406529 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.406502 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm"] May 27 17:44:00.406672 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.406636 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" May 27 17:44:00.409610 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.409587 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 17:44:00.409725 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.409630 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5vtcl\"" May 27 17:44:00.410303 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.410289 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 17:44:00.505689 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.505658 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4vw\" (UniqueName: \"kubernetes.io/projected/0a790967-a53a-4a9a-a33c-8158e206003c-kube-api-access-rd4vw\") pod \"migrator-b985f5d89-dbclm\" (UID: \"0a790967-a53a-4a9a-a33c-8158e206003c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" May 27 17:44:00.606714 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.606676 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4vw\" (UniqueName: \"kubernetes.io/projected/0a790967-a53a-4a9a-a33c-8158e206003c-kube-api-access-rd4vw\") pod \"migrator-b985f5d89-dbclm\" (UID: \"0a790967-a53a-4a9a-a33c-8158e206003c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" May 27 17:44:00.616949 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.616930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4vw\" (UniqueName: \"kubernetes.io/projected/0a790967-a53a-4a9a-a33c-8158e206003c-kube-api-access-rd4vw\") pod \"migrator-b985f5d89-dbclm\" (UID: \"0a790967-a53a-4a9a-a33c-8158e206003c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" May 27 17:44:00.715223 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.715165 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" May 27 17:44:00.888413 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:00.888381 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm"] May 27 17:44:00.893227 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:00.893198 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a790967_a53a_4a9a_a33c_8158e206003c.slice/crio-594345b4114caeb57d8f93f367ed4aa1927c3af0ce02f0562be30d7141bebbf0 WatchSource:0}: Error finding container 594345b4114caeb57d8f93f367ed4aa1927c3af0ce02f0562be30d7141bebbf0: Status 404 returned error can't find the container with id 594345b4114caeb57d8f93f367ed4aa1927c3af0ce02f0562be30d7141bebbf0 May 27 17:44:01.381976 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:01.381935 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" event={"ID":"0a790967-a53a-4a9a-a33c-8158e206003c","Type":"ContainerStarted","Data":"594345b4114caeb57d8f93f367ed4aa1927c3af0ce02f0562be30d7141bebbf0"} May 27 17:44:03.226045 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.226010 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:44:03.228376 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.228353 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f02c97f8-6d99-4232-adff-ee0f8297efc7-original-pull-secret\") pod \"global-pull-secret-syncer-g952z\" (UID: \"f02c97f8-6d99-4232-adff-ee0f8297efc7\") " pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:44:03.276337 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.276306 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbbg7_e12677bd-7bd2-485c-93ff-47998853b2fa/dns-node-resolver/0.log" May 27 17:44:03.386483 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.386453 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" event={"ID":"0a790967-a53a-4a9a-a33c-8158e206003c","Type":"ContainerStarted","Data":"4839fa72791362a94a2ffdf4076c021043a6f9dd8a38040880e6a2a68c8d5cad"} May 27 17:44:03.386646 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.386491 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" event={"ID":"0a790967-a53a-4a9a-a33c-8158e206003c","Type":"ContainerStarted","Data":"0af9cd6b45595f69c6adaaaacb49c5d0be871524d8c7959840f5f9235dd98047"} May 27 17:44:03.406259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.406220 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-dbclm" podStartSLOduration=1.936038742 podStartE2EDuration="3.406208365s" podCreationTimestamp="2026-05-27 17:44:00 +0000 UTC" firstStartedPulling="2026-05-27 17:44:00.895118123 +0000 UTC m=+43.331450152" lastFinishedPulling="2026-05-27 17:44:02.365287741 +0000 UTC m=+44.801619775" observedRunningTime="2026-05-27 17:44:03.405535564 +0000 UTC m=+45.841867616" watchObservedRunningTime="2026-05-27 17:44:03.406208365 +0000 UTC m=+45.842540417" May 27 17:44:03.421004 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.420986 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g952z" May 27 17:44:03.556451 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.556421 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g952z"] May 27 17:44:03.562314 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:03.562287 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02c97f8_6d99_4232_adff_ee0f8297efc7.slice/crio-d3fd556607321d4800f5b0b0ec874aa8da30ca7ea4e211cb4350820ce63dc627 WatchSource:0}: Error finding container d3fd556607321d4800f5b0b0ec874aa8da30ca7ea4e211cb4350820ce63dc627: Status 404 returned error can't find the container with id d3fd556607321d4800f5b0b0ec874aa8da30ca7ea4e211cb4350820ce63dc627 May 27 17:44:03.659011 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.658984 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p85tq"] May 27 17:44:03.694429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.694397 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p85tq"] May 27 17:44:03.694575 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.694445 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.697469 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.697432 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 17:44:03.697469 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.697441 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 17:44:03.697651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.697507 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 17:44:03.697773 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.697761 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mm5jv\"" May 27 17:44:03.697855 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.697837 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 17:44:03.832017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.831930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-key\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.832017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.831999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-cabundle\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.832192 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.832030 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4zt\" (UniqueName: \"kubernetes.io/projected/35f4df86-e1e4-4727-9cd4-e5096c34738d-kube-api-access-lz4zt\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.932738 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.932703 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-cabundle\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.932738 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.932739 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4zt\" (UniqueName: \"kubernetes.io/projected/35f4df86-e1e4-4727-9cd4-e5096c34738d-kube-api-access-lz4zt\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.932918 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.932814 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-key\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.933333 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.933309 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-cabundle\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.935227 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.935204 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35f4df86-e1e4-4727-9cd4-e5096c34738d-signing-key\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:03.941879 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:03.941850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4zt\" (UniqueName: \"kubernetes.io/projected/35f4df86-e1e4-4727-9cd4-e5096c34738d-kube-api-access-lz4zt\") pod \"service-ca-67d667c7d-p85tq\" (UID: \"35f4df86-e1e4-4727-9cd4-e5096c34738d\") " pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:04.003856 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:04.003828 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-p85tq" May 27 17:44:04.155279 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:04.155254 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p85tq"] May 27 17:44:04.162799 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:04.162772 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f4df86_e1e4_4727_9cd4_e5096c34738d.slice/crio-63122e13f6c13b779dd714b43c6538a0ddfdad15b125c5717ecd04f3846115a4 WatchSource:0}: Error finding container 63122e13f6c13b779dd714b43c6538a0ddfdad15b125c5717ecd04f3846115a4: Status 404 returned error can't find the container with id 63122e13f6c13b779dd714b43c6538a0ddfdad15b125c5717ecd04f3846115a4 May 27 17:44:04.280299 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:04.280266 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-trt7k_62f2e298-fad1-49de-ba76-cc0747aeb067/node-ca/0.log" May 27 17:44:04.390240 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:04.390199 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g952z" event={"ID":"f02c97f8-6d99-4232-adff-ee0f8297efc7","Type":"ContainerStarted","Data":"d3fd556607321d4800f5b0b0ec874aa8da30ca7ea4e211cb4350820ce63dc627"} May 27 17:44:04.391317 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:04.391289 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-p85tq" event={"ID":"35f4df86-e1e4-4727-9cd4-e5096c34738d","Type":"ContainerStarted","Data":"63122e13f6c13b779dd714b43c6538a0ddfdad15b125c5717ecd04f3846115a4"} May 27 17:44:05.305270 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:05.305190 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dbclm_0a790967-a53a-4a9a-a33c-8158e206003c/migrator/0.log" May 27 17:44:05.476211 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:05.476177 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dbclm_0a790967-a53a-4a9a-a33c-8158e206003c/graceful-termination/0.log" May 27 17:44:07.361862 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:07.361814 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:07.361873 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:07.361951 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.361979 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.361996 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cddddc556-sjvpm: secret "image-registry-tls" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.361979 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.362058 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.362053 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls podName:8beb7586-aa55-40a9-b56a-4e05278bacad nodeName:}" failed. No retries permitted until 2026-05-27 17:44:23.362033335 +0000 UTC m=+65.798365371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls") pod "image-registry-cddddc556-sjvpm" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad") : secret "image-registry-tls" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.362094 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert podName:01620d2b-48aa-444d-a92f-9014fe394cd6 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:23.362084349 +0000 UTC m=+65.798416387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert") pod "ingress-canary-vpvtv" (UID: "01620d2b-48aa-444d-a92f-9014fe394cd6") : secret "canary-serving-cert" not found May 27 17:44:07.362252 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:07.362108 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls podName:01738e52-7941-4f85-bfe9-5a98bb5560a8 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:23.362100928 +0000 UTC m=+65.798432973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls") pod "dns-default-qml4g" (UID: "01738e52-7941-4f85-bfe9-5a98bb5560a8") : secret "dns-default-metrics-tls" not found May 27 17:44:08.400595 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:08.400538 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g952z" event={"ID":"f02c97f8-6d99-4232-adff-ee0f8297efc7","Type":"ContainerStarted","Data":"23b5b2e2e59b98ed3a29a13a11fd7578f970ecef6bf4a172bf5399b1a606dfa8"} May 27 17:44:08.402307 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:08.402263 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-p85tq" event={"ID":"35f4df86-e1e4-4727-9cd4-e5096c34738d","Type":"ContainerStarted","Data":"1dd3648758f40cf940e34e848a22016b69b1cae18c7e58f41c8e13ae17102b63"} May 27 17:44:08.456671 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:08.456580 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g952z" podStartSLOduration=33.391043876 podStartE2EDuration="37.456547909s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:44:03.567305673 +0000 UTC m=+46.003637703" lastFinishedPulling="2026-05-27 17:44:07.632809702 +0000 UTC m=+50.069141736" observedRunningTime="2026-05-27 17:44:08.455632769 +0000 UTC m=+50.891964840" watchObservedRunningTime="2026-05-27 17:44:08.456547909 +0000 UTC m=+50.892879961" May 27 17:44:08.510018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:08.509960 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-p85tq" podStartSLOduration=2.052745551 podStartE2EDuration="5.509940603s" podCreationTimestamp="2026-05-27 17:44:03 +0000 UTC" firstStartedPulling="2026-05-27 17:44:04.165181892 +0000 UTC m=+46.601513935" lastFinishedPulling="2026-05-27 17:44:07.622376954 +0000 UTC m=+50.058708987" observedRunningTime="2026-05-27 17:44:08.509163585 +0000 UTC m=+50.945495640" watchObservedRunningTime="2026-05-27 17:44:08.509940603 +0000 UTC m=+50.946272657" May 27 17:44:19.222781 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:19.222744 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdw22" May 27 17:44:23.390063 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.390030 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:23.390545 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.390092 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:44:23.390545 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.390124 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:44:23.392511 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.392487 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01738e52-7941-4f85-bfe9-5a98bb5560a8-metrics-tls\") pod \"dns-default-qml4g\" (UID: \"01738e52-7941-4f85-bfe9-5a98bb5560a8\") " pod="openshift-dns/dns-default-qml4g" May 27 17:44:23.392640 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.392543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01620d2b-48aa-444d-a92f-9014fe394cd6-cert\") pod \"ingress-canary-vpvtv\" (UID: \"01620d2b-48aa-444d-a92f-9014fe394cd6\") " pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:44:23.392640 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.392605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"image-registry-cddddc556-sjvpm\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:23.584000 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.583967 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp774\"" May 27 17:44:23.591036 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.591010 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:23.598747 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.598723 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv9xv\"" May 27 17:44:23.606148 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.606118 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qml4g" May 27 17:44:23.616536 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.616516 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prtm9\"" May 27 17:44:23.623960 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.623937 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpvtv" May 27 17:44:23.747204 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.747170 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:44:23.757936 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:23.757807 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8beb7586_aa55_40a9_b56a_4e05278bacad.slice/crio-d698b069a642682fddcc28dcecfed776efbe9c9ca0d9b1243db5c3f6ce04c0fd WatchSource:0}: Error finding container d698b069a642682fddcc28dcecfed776efbe9c9ca0d9b1243db5c3f6ce04c0fd: Status 404 returned error can't find the container with id d698b069a642682fddcc28dcecfed776efbe9c9ca0d9b1243db5c3f6ce04c0fd May 27 17:44:23.777636 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.777607 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qml4g"] May 27 17:44:23.784956 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.784919 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpvtv"] May 27 17:44:23.788239 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:23.788205 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01620d2b_48aa_444d_a92f_9014fe394cd6.slice/crio-0b192c4529db8a4ec3b1df032a48bc111a779cedbfd9082cef5619d280415b58 WatchSource:0}: Error finding container 0b192c4529db8a4ec3b1df032a48bc111a779cedbfd9082cef5619d280415b58: Status 404 returned error can't find the container with id 0b192c4529db8a4ec3b1df032a48bc111a779cedbfd9082cef5619d280415b58 May 27 17:44:23.788787 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:23.788769 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01738e52_7941_4f85_bfe9_5a98bb5560a8.slice/crio-8deb4868d42c8bb9bd2a80a0669e26775226203a2fb354e3b38cc162ba696d0c WatchSource:0}: Error finding container 8deb4868d42c8bb9bd2a80a0669e26775226203a2fb354e3b38cc162ba696d0c: Status 404 returned error can't find the container with id 8deb4868d42c8bb9bd2a80a0669e26775226203a2fb354e3b38cc162ba696d0c May 27 17:44:23.994591 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.994490 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:44:23.994591 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.994541 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:44:23.998969 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.998947 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 17:44:23.999053 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:23.998994 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 17:44:24.007419 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.007393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a39535-6a8b-4f87-9f0b-65535fe15f3d-metrics-certs\") pod \"network-metrics-daemon-7nwgk\" (UID: \"d2a39535-6a8b-4f87-9f0b-65535fe15f3d\") " pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:44:24.008408 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.008391 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 17:44:24.017653 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.017627 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwnv2\" (UniqueName: \"kubernetes.io/projected/52cf2a63-1cda-44ec-82f7-fcbf484fb66a-kube-api-access-vwnv2\") pod \"network-check-target-9gbl6\" (UID: \"52cf2a63-1cda-44ec-82f7-fcbf484fb66a\") " pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:44:24.119185 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.119156 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frs9q\"" May 27 17:44:24.126675 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.126649 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:44:24.128127 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.128098 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\"" May 27 17:44:24.136243 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.136223 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7nwgk" May 27 17:44:24.282310 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.282165 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gbl6"] May 27 17:44:24.287203 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:24.287159 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cf2a63_1cda_44ec_82f7_fcbf484fb66a.slice/crio-8ef9fc103db6b096d673ea8bc14bee5e96275e2f4ab64976782f84ec6dfa083c WatchSource:0}: Error finding container 8ef9fc103db6b096d673ea8bc14bee5e96275e2f4ab64976782f84ec6dfa083c: Status 404 returned error can't find the container with id 8ef9fc103db6b096d673ea8bc14bee5e96275e2f4ab64976782f84ec6dfa083c May 27 17:44:24.309380 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.309329 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7nwgk"] May 27 17:44:24.314962 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:24.314934 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a39535_6a8b_4f87_9f0b_65535fe15f3d.slice/crio-28fdea89cdf7b5bd8b3bd09bf71ac5308167cec73cd0df22fe0951d7b7c49ff6 WatchSource:0}: Error finding container 28fdea89cdf7b5bd8b3bd09bf71ac5308167cec73cd0df22fe0951d7b7c49ff6: Status 404 returned error can't find the container with id 28fdea89cdf7b5bd8b3bd09bf71ac5308167cec73cd0df22fe0951d7b7c49ff6 May 27 17:44:24.436094 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.436025 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7nwgk" event={"ID":"d2a39535-6a8b-4f87-9f0b-65535fe15f3d","Type":"ContainerStarted","Data":"28fdea89cdf7b5bd8b3bd09bf71ac5308167cec73cd0df22fe0951d7b7c49ff6"} May 27 17:44:24.437638 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.437607 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gbl6" event={"ID":"52cf2a63-1cda-44ec-82f7-fcbf484fb66a","Type":"ContainerStarted","Data":"8ef9fc103db6b096d673ea8bc14bee5e96275e2f4ab64976782f84ec6dfa083c"} May 27 17:44:24.439210 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.439175 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpvtv" event={"ID":"01620d2b-48aa-444d-a92f-9014fe394cd6","Type":"ContainerStarted","Data":"0b192c4529db8a4ec3b1df032a48bc111a779cedbfd9082cef5619d280415b58"} May 27 17:44:24.440854 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.440795 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" event={"ID":"8beb7586-aa55-40a9-b56a-4e05278bacad","Type":"ContainerStarted","Data":"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60"} May 27 17:44:24.440854 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.440830 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" event={"ID":"8beb7586-aa55-40a9-b56a-4e05278bacad","Type":"ContainerStarted","Data":"d698b069a642682fddcc28dcecfed776efbe9c9ca0d9b1243db5c3f6ce04c0fd"} May 27 17:44:24.441114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.441079 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:24.442098 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.442065 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qml4g" event={"ID":"01738e52-7941-4f85-bfe9-5a98bb5560a8","Type":"ContainerStarted","Data":"8deb4868d42c8bb9bd2a80a0669e26775226203a2fb354e3b38cc162ba696d0c"} May 27 17:44:24.475199 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:24.475142 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" podStartSLOduration=40.475123845 podStartE2EDuration="40.475123845s" podCreationTimestamp="2026-05-27 17:43:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:44:24.473271753 +0000 UTC m=+66.909603891" watchObservedRunningTime="2026-05-27 17:44:24.475123845 +0000 UTC m=+66.911455899" May 27 17:44:25.807321 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.807285 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fxn8b"] May 27 17:44:25.810971 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.810946 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:25.814484 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.814436 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 17:44:25.815626 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.815604 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 17:44:25.815751 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.815628 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 17:44:25.816173 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.815996 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-99xjw\"" May 27 17:44:25.816173 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.816097 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 17:44:25.828516 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.828493 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fxn8b"] May 27 17:44:25.872797 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.872769 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:44:25.910190 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.910146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:25.910362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.910195 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/544ef915-226d-4dab-bd97-1ff3ad2c30a1-crio-socket\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:25.910362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.910323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/544ef915-226d-4dab-bd97-1ff3ad2c30a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:25.910458 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.910361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rshn\" (UniqueName: \"kubernetes.io/projected/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-api-access-9rshn\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:25.910458 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:25.910400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/544ef915-226d-4dab-bd97-1ff3ad2c30a1-data-volume\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011016 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.010966 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011206 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011022 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/544ef915-226d-4dab-bd97-1ff3ad2c30a1-crio-socket\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011206 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011087 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/544ef915-226d-4dab-bd97-1ff3ad2c30a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011206 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011116 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rshn\" (UniqueName: \"kubernetes.io/projected/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-api-access-9rshn\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011206 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011153 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/544ef915-226d-4dab-bd97-1ff3ad2c30a1-data-volume\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011418 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/544ef915-226d-4dab-bd97-1ff3ad2c30a1-crio-socket\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011618 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011545 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/544ef915-226d-4dab-bd97-1ff3ad2c30a1-data-volume\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.011757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.011695 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.014282 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.014255 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/544ef915-226d-4dab-bd97-1ff3ad2c30a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.024824 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.024796 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rshn\" (UniqueName: \"kubernetes.io/projected/544ef915-226d-4dab-bd97-1ff3ad2c30a1-kube-api-access-9rshn\") pod \"insights-runtime-extractor-fxn8b\" (UID: \"544ef915-226d-4dab-bd97-1ff3ad2c30a1\") " pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.123595 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.123550 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fxn8b" May 27 17:44:26.407618 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.407584 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fxn8b"] May 27 17:44:26.417963 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:26.417920 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544ef915_226d_4dab_bd97_1ff3ad2c30a1.slice/crio-cab6c7e7f5ff92e61ace18312143f3a177e52290dd2a102e4199ee00207611aa WatchSource:0}: Error finding container cab6c7e7f5ff92e61ace18312143f3a177e52290dd2a102e4199ee00207611aa: Status 404 returned error can't find the container with id cab6c7e7f5ff92e61ace18312143f3a177e52290dd2a102e4199ee00207611aa May 27 17:44:26.453980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.453953 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qml4g" event={"ID":"01738e52-7941-4f85-bfe9-5a98bb5560a8","Type":"ContainerStarted","Data":"0d5d81cf9b01477a14f3329932e929fb50ee10524570d5e5497c4b26509c3ae2"} May 27 17:44:26.457222 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.457157 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7nwgk" event={"ID":"d2a39535-6a8b-4f87-9f0b-65535fe15f3d","Type":"ContainerStarted","Data":"79e0669c1e5df7a56b8d3f03b7a910c575dd288d72605d149cbd10784d6dc0be"} May 27 17:44:26.458975 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.458947 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpvtv" event={"ID":"01620d2b-48aa-444d-a92f-9014fe394cd6","Type":"ContainerStarted","Data":"0b7afc3b0d6f27b655f4ce213cecf35fe14fc6584543ecc406abba01d6cc44dd"} May 27 17:44:26.460909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:26.460862 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxn8b" event={"ID":"544ef915-226d-4dab-bd97-1ff3ad2c30a1","Type":"ContainerStarted","Data":"cab6c7e7f5ff92e61ace18312143f3a177e52290dd2a102e4199ee00207611aa"} May 27 17:44:27.466419 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.466374 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7nwgk" event={"ID":"d2a39535-6a8b-4f87-9f0b-65535fe15f3d","Type":"ContainerStarted","Data":"501902c796ae70b28bc2f4faaed02a7e215266116bece79d4dfe12d2ba232988"} May 27 17:44:27.468061 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.468028 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxn8b" event={"ID":"544ef915-226d-4dab-bd97-1ff3ad2c30a1","Type":"ContainerStarted","Data":"6c0b1b968df44b2fc9cc09ade1ffb6ecedd6d91cc1ad3bf0549af1f8ceaeb95e"} May 27 17:44:27.469715 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.469688 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qml4g" event={"ID":"01738e52-7941-4f85-bfe9-5a98bb5560a8","Type":"ContainerStarted","Data":"3cf79b8f9a8c07d00f8a95980b1a77e024f217998a75a5e8528804f5870a9ba5"} May 27 17:44:27.485799 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.485753 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7nwgk" podStartSLOduration=67.575222063 podStartE2EDuration="1m9.485734631s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:44:24.31768878 +0000 UTC m=+66.754020824" lastFinishedPulling="2026-05-27 17:44:26.228201351 +0000 UTC m=+68.664533392" observedRunningTime="2026-05-27 17:44:27.485036837 +0000 UTC m=+69.921368892" watchObservedRunningTime="2026-05-27 17:44:27.485734631 +0000 UTC m=+69.922066679" May 27 17:44:27.485943 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.485898 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vpvtv" podStartSLOduration=34.046702145 podStartE2EDuration="36.485891082s" podCreationTimestamp="2026-05-27 17:43:51 +0000 UTC" firstStartedPulling="2026-05-27 17:44:23.790175548 +0000 UTC m=+66.226507592" lastFinishedPulling="2026-05-27 17:44:26.229364484 +0000 UTC m=+68.665696529" observedRunningTime="2026-05-27 17:44:26.486454223 +0000 UTC m=+68.922786288" watchObservedRunningTime="2026-05-27 17:44:27.485891082 +0000 UTC m=+69.922223149" May 27 17:44:27.505276 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:27.505224 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qml4g" podStartSLOduration=34.067650787 podStartE2EDuration="36.505206786s" podCreationTimestamp="2026-05-27 17:43:51 +0000 UTC" firstStartedPulling="2026-05-27 17:44:23.79062289 +0000 UTC m=+66.226954924" lastFinishedPulling="2026-05-27 17:44:26.228178886 +0000 UTC m=+68.664510923" observedRunningTime="2026-05-27 17:44:27.504013367 +0000 UTC m=+69.940345419" watchObservedRunningTime="2026-05-27 17:44:27.505206786 +0000 UTC m=+69.941538840" May 27 17:44:28.473633 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:28.473570 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gbl6" event={"ID":"52cf2a63-1cda-44ec-82f7-fcbf484fb66a","Type":"ContainerStarted","Data":"493ece907138b17db902b935c7dc9ab052645e4d66a418c36a4a3553ddaa7526"} May 27 17:44:28.474110 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:28.473838 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:44:28.475750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:28.475717 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxn8b" event={"ID":"544ef915-226d-4dab-bd97-1ff3ad2c30a1","Type":"ContainerStarted","Data":"a2a58e9db3161d255b58950d63c4f616fbdab7e615ab6973e0510657df49e8c6"} May 27 17:44:28.476164 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:28.476140 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qml4g" May 27 17:44:28.492788 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:28.492731 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9gbl6" podStartSLOduration=66.849328254 podStartE2EDuration="1m10.492718131s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:44:24.289542579 +0000 UTC m=+66.725874609" lastFinishedPulling="2026-05-27 17:44:27.932932454 +0000 UTC m=+70.369264486" observedRunningTime="2026-05-27 17:44:28.491205511 +0000 UTC m=+70.927537563" watchObservedRunningTime="2026-05-27 17:44:28.492718131 +0000 UTC m=+70.929050183" May 27 17:44:29.482685 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:29.482587 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxn8b" event={"ID":"544ef915-226d-4dab-bd97-1ff3ad2c30a1","Type":"ContainerStarted","Data":"fd1ad7352778245dabec346bdf4e4b58d8ea544efa38bed78d7545d8854580f5"} May 27 17:44:29.503545 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:29.503496 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fxn8b" podStartSLOduration=1.869905234 podStartE2EDuration="4.503482399s" podCreationTimestamp="2026-05-27 17:44:25 +0000 UTC" firstStartedPulling="2026-05-27 17:44:26.516212079 +0000 UTC m=+68.952544109" lastFinishedPulling="2026-05-27 17:44:29.149789241 +0000 UTC m=+71.586121274" observedRunningTime="2026-05-27 17:44:29.502784013 +0000 UTC m=+71.939116066" watchObservedRunningTime="2026-05-27 17:44:29.503482399 +0000 UTC m=+71.939814451" May 27 17:44:38.486012 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:38.485890 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qml4g" May 27 17:44:46.466779 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:46.466752 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:51.485695 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.485653 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" podUID="8beb7586-aa55-40a9-b56a-4e05278bacad" containerName="registry" containerID="cri-o://3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60" gracePeriod=30 May 27 17:44:51.713335 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.713315 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:51.787223 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787139 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgzgr\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787223 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787185 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787223 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787207 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787470 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787227 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787470 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787362 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787470 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787415 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787473 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787499 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token\") pod \"8beb7586-aa55-40a9-b56a-4e05278bacad\" (UID: \"8beb7586-aa55-40a9-b56a-4e05278bacad\") " May 27 17:44:51.787674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787643 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:44:51.787829 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787734 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-certificates\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.787829 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.787746 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:44:51.789934 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.789872 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:44:51.789934 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.789884 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr" (OuterVolumeSpecName: "kube-api-access-qgzgr") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "kube-api-access-qgzgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:44:51.790157 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.790128 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:44:51.790213 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.790184 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:44:51.790253 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.790219 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:44:51.796097 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.796075 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8beb7586-aa55-40a9-b56a-4e05278bacad" (UID: "8beb7586-aa55-40a9-b56a-4e05278bacad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:44:51.888674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888640 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgzgr\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-kube-api-access-qgzgr\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888669 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-image-registry-private-configuration\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888681 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8beb7586-aa55-40a9-b56a-4e05278bacad-trusted-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888902 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888690 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8beb7586-aa55-40a9-b56a-4e05278bacad-ca-trust-extracted\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888902 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888699 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-registry-tls\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888902 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888708 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8beb7586-aa55-40a9-b56a-4e05278bacad-installation-pull-secrets\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:51.888902 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:51.888717 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8beb7586-aa55-40a9-b56a-4e05278bacad-bound-sa-token\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:44:52.540551 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.540467 2552 generic.go:358] "Generic (PLEG): container finished" podID="8beb7586-aa55-40a9-b56a-4e05278bacad" containerID="3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60" exitCode=0 May 27 17:44:52.540957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.540546 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" event={"ID":"8beb7586-aa55-40a9-b56a-4e05278bacad","Type":"ContainerDied","Data":"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60"} May 27 17:44:52.540957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.540580 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" May 27 17:44:52.540957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.540602 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cddddc556-sjvpm" event={"ID":"8beb7586-aa55-40a9-b56a-4e05278bacad","Type":"ContainerDied","Data":"d698b069a642682fddcc28dcecfed776efbe9c9ca0d9b1243db5c3f6ce04c0fd"} May 27 17:44:52.540957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.540618 2552 scope.go:117] "RemoveContainer" containerID="3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60" May 27 17:44:52.550386 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.550362 2552 scope.go:117] "RemoveContainer" containerID="3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60" May 27 17:44:52.550697 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:44:52.550671 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60\": container with ID starting with 3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60 not found: ID does not exist" containerID="3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60" May 27 17:44:52.550757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.550705 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60"} err="failed to get container status \"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60\": rpc error: code = NotFound desc = could not find container \"3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60\": container with ID starting with 3562e0aca597e66526506266ca63b00be4c6abfe19a981bf8d163e8cc7b6fd60 not found: ID does not exist" May 27 17:44:52.626784 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.626758 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:44:52.632284 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:52.632264 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cddddc556-sjvpm"] May 27 17:44:53.197806 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.197775 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj"] May 27 17:44:53.198019 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.198007 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8beb7586-aa55-40a9-b56a-4e05278bacad" containerName="registry" May 27 17:44:53.198062 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.198021 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8beb7586-aa55-40a9-b56a-4e05278bacad" containerName="registry" May 27 17:44:53.198095 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.198068 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8beb7586-aa55-40a9-b56a-4e05278bacad" containerName="registry" May 27 17:44:53.202404 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.202387 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.207269 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.207234 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 27 17:44:53.207269 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.207236 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 27 17:44:53.208524 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.208455 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 17:44:53.208652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.208594 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wtvzw\"" May 27 17:44:53.208652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.208604 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 17:44:53.208768 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.208682 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 17:44:53.216375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.216355 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj"] May 27 17:44:53.299241 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.299214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69810011-7ea1-4bad-a824-445e8b13d129-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.299409 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.299250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.299409 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.299276 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9m4r\" (UniqueName: \"kubernetes.io/projected/69810011-7ea1-4bad-a824-445e8b13d129-kube-api-access-k9m4r\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.299409 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.299353 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.400072 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.400039 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.400219 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.400082 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69810011-7ea1-4bad-a824-445e8b13d129-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.400219 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.400202 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.400292 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.400240 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9m4r\" (UniqueName: \"kubernetes.io/projected/69810011-7ea1-4bad-a824-445e8b13d129-kube-api-access-k9m4r\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.400726 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.400699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69810011-7ea1-4bad-a824-445e8b13d129-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.402414 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.402388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.402514 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.402482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69810011-7ea1-4bad-a824-445e8b13d129-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.417703 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.417683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9m4r\" (UniqueName: \"kubernetes.io/projected/69810011-7ea1-4bad-a824-445e8b13d129-kube-api-access-k9m4r\") pod \"prometheus-operator-7779bbdd78-t7cbj\" (UID: \"69810011-7ea1-4bad-a824-445e8b13d129\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.511289 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.511220 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" May 27 17:44:53.635482 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:53.635447 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj"] May 27 17:44:53.639353 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:53.639325 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69810011_7ea1_4bad_a824_445e8b13d129.slice/crio-1077c3b0e659038a8817dad32c03f0d983473e260e1d01cc37a4811a85730316 WatchSource:0}: Error finding container 1077c3b0e659038a8817dad32c03f0d983473e260e1d01cc37a4811a85730316: Status 404 returned error can't find the container with id 1077c3b0e659038a8817dad32c03f0d983473e260e1d01cc37a4811a85730316 May 27 17:44:54.210154 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:54.210123 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8beb7586-aa55-40a9-b56a-4e05278bacad" path="/var/lib/kubelet/pods/8beb7586-aa55-40a9-b56a-4e05278bacad/volumes" May 27 17:44:54.548610 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:54.548513 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" event={"ID":"69810011-7ea1-4bad-a824-445e8b13d129","Type":"ContainerStarted","Data":"1077c3b0e659038a8817dad32c03f0d983473e260e1d01cc37a4811a85730316"} May 27 17:44:55.552486 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:55.552441 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" event={"ID":"69810011-7ea1-4bad-a824-445e8b13d129","Type":"ContainerStarted","Data":"fd891408198ad9319c25e469e37277ed353c1b51152f105e5e9eb3b75a10eeba"} May 27 17:44:55.552486 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:55.552490 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" event={"ID":"69810011-7ea1-4bad-a824-445e8b13d129","Type":"ContainerStarted","Data":"06416ac19e368015453de895d1f3e261bba8562e09f1f6c6e96e81d04433b11d"} May 27 17:44:55.573421 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:55.573330 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-t7cbj" podStartSLOduration=1.414121996 podStartE2EDuration="2.573317041s" podCreationTimestamp="2026-05-27 17:44:53 +0000 UTC" firstStartedPulling="2026-05-27 17:44:53.641054251 +0000 UTC m=+96.077386295" lastFinishedPulling="2026-05-27 17:44:54.800249309 +0000 UTC m=+97.236581340" observedRunningTime="2026-05-27 17:44:55.572005023 +0000 UTC m=+98.008337075" watchObservedRunningTime="2026-05-27 17:44:55.573317041 +0000 UTC m=+98.009649092" May 27 17:44:57.591976 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.591944 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq"] May 27 17:44:57.596066 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.596039 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-drng8"] May 27 17:44:57.596250 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.596227 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.598823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.598798 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 17:44:57.598823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.598811 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 17:44:57.599161 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.599144 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.599280 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.599166 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zlspc\"" May 27 17:44:57.599280 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.599236 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 17:44:57.601522 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.601500 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4klfq\"" May 27 17:44:57.601701 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.601684 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 17:44:57.601767 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.601722 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 17:44:57.602214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.602191 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 17:44:57.610600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.610578 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq"] May 27 17:44:57.730684 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-metrics-client-ca\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.730846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730694 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdw2\" (UniqueName: \"kubernetes.io/projected/d480af2c-5611-4642-a4d0-4d325fec8421-kube-api-access-zxdw2\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.730846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-tls\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.730846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-textfile\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.730846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730803 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.730846 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx7lb\" (UniqueName: \"kubernetes.io/projected/cbe6b288-9aaf-40e4-a654-a287b447baa1-kube-api-access-lx7lb\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.731101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d480af2c-5611-4642-a4d0-4d325fec8421-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.731101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.730961 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.731101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731000 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-sys\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.731101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731034 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.731101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731074 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.731272 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731112 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-root\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.731272 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731204 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.731272 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-wtmp\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.731365 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.731276 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832133 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832097 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832133 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832134 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-wtmp\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832164 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832196 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-metrics-client-ca\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832221 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdw2\" (UniqueName: \"kubernetes.io/projected/d480af2c-5611-4642-a4d0-4d325fec8421-kube-api-access-zxdw2\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832250 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-tls\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832274 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-textfile\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832300 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-wtmp\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832326 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx7lb\" (UniqueName: \"kubernetes.io/projected/cbe6b288-9aaf-40e4-a654-a287b447baa1-kube-api-access-lx7lb\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832365 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d480af2c-5611-4642-a4d0-4d325fec8421-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832399 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832425 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-sys\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832460 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832498 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832532 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-root\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-textfile\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832646 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-root\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.832800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832672 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe6b288-9aaf-40e4-a654-a287b447baa1-sys\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.833183 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.832857 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.833183 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.833040 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.833183 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.833067 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d480af2c-5611-4642-a4d0-4d325fec8421-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.833325 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.833280 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d480af2c-5611-4642-a4d0-4d325fec8421-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.833374 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.833323 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe6b288-9aaf-40e4-a654-a287b447baa1-metrics-client-ca\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.835247 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.835217 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.835247 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.835242 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.835548 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.835527 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbe6b288-9aaf-40e4-a654-a287b447baa1-node-exporter-tls\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.835613 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.835549 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d480af2c-5611-4642-a4d0-4d325fec8421-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.845499 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.845474 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdw2\" (UniqueName: \"kubernetes.io/projected/d480af2c-5611-4642-a4d0-4d325fec8421-kube-api-access-zxdw2\") pod \"kube-state-metrics-54fd6bc5c4-6zclq\" (UID: \"d480af2c-5611-4642-a4d0-4d325fec8421\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.850667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.850646 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx7lb\" (UniqueName: \"kubernetes.io/projected/cbe6b288-9aaf-40e4-a654-a287b447baa1-kube-api-access-lx7lb\") pod \"node-exporter-drng8\" (UID: \"cbe6b288-9aaf-40e4-a654-a287b447baa1\") " pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.907794 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.907756 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" May 27 17:44:57.914623 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:57.914594 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-drng8" May 27 17:44:57.923052 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:57.923023 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe6b288_9aaf_40e4_a654_a287b447baa1.slice/crio-d9385b5acb00ff27693c5927665c15a24f028f560396cd7b88586044ee8703be WatchSource:0}: Error finding container d9385b5acb00ff27693c5927665c15a24f028f560396cd7b88586044ee8703be: Status 404 returned error can't find the container with id d9385b5acb00ff27693c5927665c15a24f028f560396cd7b88586044ee8703be May 27 17:44:58.052573 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:58.052532 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq"] May 27 17:44:58.055205 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:44:58.055172 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd480af2c_5611_4642_a4d0_4d325fec8421.slice/crio-5ddbf631e28d395e64672f82440530235ff0dd8bba801a2a9242b40a0b4b7244 WatchSource:0}: Error finding container 5ddbf631e28d395e64672f82440530235ff0dd8bba801a2a9242b40a0b4b7244: Status 404 returned error can't find the container with id 5ddbf631e28d395e64672f82440530235ff0dd8bba801a2a9242b40a0b4b7244 May 27 17:44:58.562806 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:58.562760 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" event={"ID":"d480af2c-5611-4642-a4d0-4d325fec8421","Type":"ContainerStarted","Data":"5ddbf631e28d395e64672f82440530235ff0dd8bba801a2a9242b40a0b4b7244"} May 27 17:44:58.564276 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:58.564221 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-drng8" event={"ID":"cbe6b288-9aaf-40e4-a654-a287b447baa1","Type":"ContainerStarted","Data":"d9385b5acb00ff27693c5927665c15a24f028f560396cd7b88586044ee8703be"} May 27 17:44:59.485695 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.485662 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9gbl6" May 27 17:44:59.569090 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.569033 2552 generic.go:358] "Generic (PLEG): container finished" podID="cbe6b288-9aaf-40e4-a654-a287b447baa1" containerID="4e8e99e8e0b246693da95e5828859d702b2bc4eaa057fe680bcf01117328051e" exitCode=0 May 27 17:44:59.569255 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.569114 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-drng8" event={"ID":"cbe6b288-9aaf-40e4-a654-a287b447baa1","Type":"ContainerDied","Data":"4e8e99e8e0b246693da95e5828859d702b2bc4eaa057fe680bcf01117328051e"} May 27 17:44:59.601785 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.601745 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56597b4f49-48hmn"] May 27 17:44:59.618615 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.618587 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.619704 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.619673 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56597b4f49-48hmn"] May 27 17:44:59.621429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.621405 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 17:44:59.626728 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.626711 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2898pj2qvnae2\"" May 27 17:44:59.626833 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.626716 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 17:44:59.627056 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.627035 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 17:44:59.627163 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.627066 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lpztd\"" May 27 17:44:59.627377 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.627359 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 17:44:59.627455 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.627359 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 17:44:59.748319 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748328 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-grpc-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748346 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7889r\" (UniqueName: \"kubernetes.io/projected/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-kube-api-access-7889r\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748539 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748539 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-metrics-client-ca\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748539 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748511 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748680 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.748680 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.748614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.849842 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.849809 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850014 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.849853 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-metrics-client-ca\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850014 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.849878 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850098 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850043 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850098 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850083 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850132 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850159 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-grpc-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850249 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850186 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7889r\" (UniqueName: \"kubernetes.io/projected/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-kube-api-access-7889r\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.850813 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.850781 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-metrics-client-ca\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.852473 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.852444 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.852771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.852752 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.852771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.852759 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.852954 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.852841 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.852954 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.852882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.853245 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.853226 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-secret-grpc-tls\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.858908 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.858890 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7889r\" (UniqueName: \"kubernetes.io/projected/6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4-kube-api-access-7889r\") pod \"thanos-querier-56597b4f49-48hmn\" (UID: \"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4\") " pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:44:59.929942 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:44:59.929911 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:45:00.068497 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.068455 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56597b4f49-48hmn"] May 27 17:45:00.070786 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:45:00.070740 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9fa8eb_8660_496b_b8d9_bf8cbd8e30b4.slice/crio-e830fc1ce40fcec05fbcf20470738b06513d4aa74fc3d9d4a3e21e196ddb3ba0 WatchSource:0}: Error finding container e830fc1ce40fcec05fbcf20470738b06513d4aa74fc3d9d4a3e21e196ddb3ba0: Status 404 returned error can't find the container with id e830fc1ce40fcec05fbcf20470738b06513d4aa74fc3d9d4a3e21e196ddb3ba0 May 27 17:45:00.579892 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.579794 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"e830fc1ce40fcec05fbcf20470738b06513d4aa74fc3d9d4a3e21e196ddb3ba0"} May 27 17:45:00.585955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.585917 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-drng8" event={"ID":"cbe6b288-9aaf-40e4-a654-a287b447baa1","Type":"ContainerStarted","Data":"c5162841b82e2f2a0ff4e8cf8f0fd321e70cd85c9759e117224272357ca7225b"} May 27 17:45:00.586113 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.585974 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-drng8" event={"ID":"cbe6b288-9aaf-40e4-a654-a287b447baa1","Type":"ContainerStarted","Data":"20a5d0d75e0da71e21d232b14c1d6f5eeea193a42740775951e1a327766c92fb"} May 27 17:45:00.589849 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.589820 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" event={"ID":"d480af2c-5611-4642-a4d0-4d325fec8421","Type":"ContainerStarted","Data":"3b495b02c0b092d4ca64d74979b7ed95a7acf4fdd515d20b62d0c63af6e68c5e"} May 27 17:45:00.590004 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.589990 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" event={"ID":"d480af2c-5611-4642-a4d0-4d325fec8421","Type":"ContainerStarted","Data":"060db3fc4d8788d93bb65ae55df57de4df1b53736b478f7becf9e3439e7734cf"} May 27 17:45:00.590089 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.590078 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" event={"ID":"d480af2c-5611-4642-a4d0-4d325fec8421","Type":"ContainerStarted","Data":"53e2a0f85c02ebf2a4be9813883dd363929bc2dc3b0719dee12071197b8c107b"} May 27 17:45:00.608641 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.608579 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-drng8" podStartSLOduration=2.604660887 podStartE2EDuration="3.608528155s" podCreationTimestamp="2026-05-27 17:44:57 +0000 UTC" firstStartedPulling="2026-05-27 17:44:57.924793324 +0000 UTC m=+100.361125357" lastFinishedPulling="2026-05-27 17:44:58.928660578 +0000 UTC m=+101.364992625" observedRunningTime="2026-05-27 17:45:00.607274467 +0000 UTC m=+103.043606529" watchObservedRunningTime="2026-05-27 17:45:00.608528155 +0000 UTC m=+103.044860208" May 27 17:45:00.629011 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:00.628955 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6zclq" podStartSLOduration=1.745763046 podStartE2EDuration="3.628936594s" podCreationTimestamp="2026-05-27 17:44:57 +0000 UTC" firstStartedPulling="2026-05-27 17:44:58.057083378 +0000 UTC m=+100.493415407" lastFinishedPulling="2026-05-27 17:44:59.94025692 +0000 UTC m=+102.376588955" observedRunningTime="2026-05-27 17:45:00.62836014 +0000 UTC m=+103.064692205" watchObservedRunningTime="2026-05-27 17:45:00.628936594 +0000 UTC m=+103.065268647" May 27 17:45:02.597827 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:02.597794 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"ff08392e5a9a8843b73c74c9d6c36fc67cf808b242dd485f616fc72b5766a6ad"} May 27 17:45:02.598191 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:02.597834 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"ffbca6012cc45a8207c14dda6d7cfb5d111d8372f86e5c5a68d05ed544fceadd"} May 27 17:45:02.598191 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:02.597845 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"ab663b45e94f846d5ff93d9df68e63219fd285fc371f6880ca16000652ef0860"} May 27 17:45:03.604265 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:03.604232 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"c408f69a7375ae324e9c399729b68268835af72e20e7db09fef7c27958c6f220"} May 27 17:45:03.604635 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:03.604270 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"6c489cf51fecccb7b963a83a09d110f4e937cd790356125301a66e5e8384fc91"} May 27 17:45:04.609225 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:04.609183 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" event={"ID":"6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4","Type":"ContainerStarted","Data":"f30abaad7e582213863d8834308c092499ab567f67208c09028615079f3645bb"} May 27 17:45:04.609662 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:04.609362 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:45:04.639809 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:04.639197 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" podStartSLOduration=2.252982179 podStartE2EDuration="5.639178337s" podCreationTimestamp="2026-05-27 17:44:59 +0000 UTC" firstStartedPulling="2026-05-27 17:45:00.07281431 +0000 UTC m=+102.509146340" lastFinishedPulling="2026-05-27 17:45:03.459010456 +0000 UTC m=+105.895342498" observedRunningTime="2026-05-27 17:45:04.638524015 +0000 UTC m=+107.074856067" watchObservedRunningTime="2026-05-27 17:45:04.639178337 +0000 UTC m=+107.075510390" May 27 17:45:06.636935 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:06.636898 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpvtv_01620d2b-48aa-444d-a92f-9014fe394cd6/serve-healthcheck-canary/0.log" May 27 17:45:10.618385 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:10.618358 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56597b4f49-48hmn" May 27 17:45:11.749734 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.749699 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:45:11.752661 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.752642 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.757210 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.757189 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 17:45:11.757396 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.757373 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 17:45:11.757474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.757401 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 17:45:11.757528 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.757509 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 17:45:11.758506 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.758489 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 17:45:11.758619 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.758543 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 17:45:11.758823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.758807 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bcfvf\"" May 27 17:45:11.758913 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.758809 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 17:45:11.762452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.762434 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 17:45:11.769750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.769730 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:45:11.854101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854101 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854103 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854323 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854323 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854323 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854287 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854419 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854329 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.854419 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.854389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd8l\" (UniqueName: \"kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.955779 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955744 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.955779 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955786 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955804 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955842 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd8l\" (UniqueName: \"kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955860 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955875 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956017 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.955899 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956635 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.956608 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956635 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.956628 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956792 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.956617 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.956792 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.956713 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.958849 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.958828 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.958965 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.958849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:11.973030 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:11.973008 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd8l\" (UniqueName: \"kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l\") pod \"console-766698cd96-gkmw6\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:12.062023 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:12.061922 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:12.232343 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:12.232312 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:45:12.235080 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:45:12.235044 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819e54ac_1724_49d8_a308_4122207d7ef0.slice/crio-02f7a0ab3794fcb2d770540acb481cd21842f2f7c1777627ce4f0083477c1458 WatchSource:0}: Error finding container 02f7a0ab3794fcb2d770540acb481cd21842f2f7c1777627ce4f0083477c1458: Status 404 returned error can't find the container with id 02f7a0ab3794fcb2d770540acb481cd21842f2f7c1777627ce4f0083477c1458 May 27 17:45:12.630406 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:12.630369 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766698cd96-gkmw6" event={"ID":"819e54ac-1724-49d8-a308-4122207d7ef0","Type":"ContainerStarted","Data":"02f7a0ab3794fcb2d770540acb481cd21842f2f7c1777627ce4f0083477c1458"} May 27 17:45:15.641539 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:15.641503 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766698cd96-gkmw6" event={"ID":"819e54ac-1724-49d8-a308-4122207d7ef0","Type":"ContainerStarted","Data":"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3"} May 27 17:45:15.663103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:15.663047 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-766698cd96-gkmw6" podStartSLOduration=2.05258428 podStartE2EDuration="4.663030086s" podCreationTimestamp="2026-05-27 17:45:11 +0000 UTC" firstStartedPulling="2026-05-27 17:45:12.236868598 +0000 UTC m=+114.673200634" lastFinishedPulling="2026-05-27 17:45:14.847314406 +0000 UTC m=+117.283646440" observedRunningTime="2026-05-27 17:45:15.661333812 +0000 UTC m=+118.097665865" watchObservedRunningTime="2026-05-27 17:45:15.663030086 +0000 UTC m=+118.099362139" May 27 17:45:22.062969 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:22.062929 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:22.063379 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:22.062983 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:22.067641 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:22.067620 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:45:22.664889 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:45:22.664860 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:46:22.100151 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.100057 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv"] May 27 17:46:22.103574 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.103528 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.106452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.106378 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 17:46:22.106585 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.106432 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 17:46:22.106954 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.106728 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 17:46:22.107277 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.107253 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6f75l\"" May 27 17:46:22.107410 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.107390 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 17:46:22.107568 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.107540 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 17:46:22.114103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.114081 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 17:46:22.117214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.117189 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv"] May 27 17:46:22.194819 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.194780 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.194831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-federate-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.194857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.194938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.195001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-metrics-client-ca\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195192 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.195036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f822x\" (UniqueName: \"kubernetes.io/projected/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-kube-api-access-f822x\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195192 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.195057 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.195192 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.195076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-serving-certs-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296089 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296052 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-federate-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296111 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296162 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296213 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-metrics-client-ca\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296243 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f822x\" (UniqueName: \"kubernetes.io/projected/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-kube-api-access-f822x\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296268 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296296 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-serving-certs-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.296640 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.296360 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.297115 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.297050 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-metrics-client-ca\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.297482 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.297452 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-serving-certs-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.297724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.297697 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.298978 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.298953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.299060 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.298985 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-telemeter-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.299060 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.299033 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-secret-telemeter-client\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.299655 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.299616 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-federate-client-tls\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.305750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.305723 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f822x\" (UniqueName: \"kubernetes.io/projected/e0af9c0d-76d0-461e-ad3d-59113d3ee94f-kube-api-access-f822x\") pod \"telemeter-client-77fcb8bb67-z2pzv\" (UID: \"e0af9c0d-76d0-461e-ad3d-59113d3ee94f\") " pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.415749 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.415668 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" May 27 17:46:22.572405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.572379 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv"] May 27 17:46:22.574472 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:46:22.574434 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0af9c0d_76d0_461e_ad3d_59113d3ee94f.slice/crio-83014888078f4b2b7225d90a0e1ba5f0abce728665f81927c8a0adbdb78ab1dc WatchSource:0}: Error finding container 83014888078f4b2b7225d90a0e1ba5f0abce728665f81927c8a0adbdb78ab1dc: Status 404 returned error can't find the container with id 83014888078f4b2b7225d90a0e1ba5f0abce728665f81927c8a0adbdb78ab1dc May 27 17:46:22.821170 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:22.821079 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" event={"ID":"e0af9c0d-76d0-461e-ad3d-59113d3ee94f","Type":"ContainerStarted","Data":"83014888078f4b2b7225d90a0e1ba5f0abce728665f81927c8a0adbdb78ab1dc"} May 27 17:46:25.833915 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:25.833879 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" event={"ID":"e0af9c0d-76d0-461e-ad3d-59113d3ee94f","Type":"ContainerStarted","Data":"46f781a75e6ce058b3c93947d8b3ce9ef12fa56d9e4656009d630be824186dce"} May 27 17:46:26.838393 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:26.838357 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" event={"ID":"e0af9c0d-76d0-461e-ad3d-59113d3ee94f","Type":"ContainerStarted","Data":"aa05f14f00e60b283161819252dfa6a06eafba3630b18a84099661b71c8c1b51"} May 27 17:46:26.838393 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:26.838394 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" event={"ID":"e0af9c0d-76d0-461e-ad3d-59113d3ee94f","Type":"ContainerStarted","Data":"af6a4a20c9812e46bd187890f2e82f13e3707197b64d9c77483906ea1fbc41de"} May 27 17:46:26.866057 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:26.866005 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77fcb8bb67-z2pzv" podStartSLOduration=1.547977367 podStartE2EDuration="4.865983205s" podCreationTimestamp="2026-05-27 17:46:22 +0000 UTC" firstStartedPulling="2026-05-27 17:46:22.576207483 +0000 UTC m=+185.012539513" lastFinishedPulling="2026-05-27 17:46:25.894213317 +0000 UTC m=+188.330545351" observedRunningTime="2026-05-27 17:46:26.864314931 +0000 UTC m=+189.300646979" watchObservedRunningTime="2026-05-27 17:46:26.865983205 +0000 UTC m=+189.302315260" May 27 17:46:27.572255 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.572223 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:46:27.575283 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.575264 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.596081 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.596051 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:46:27.751785 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751744 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.751785 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.752050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751829 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnhs\" (UniqueName: \"kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.752050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.752050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.752050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.751994 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.752050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.752028 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853072 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853119 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853142 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853161 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853180 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853197 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.853549 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.853227 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnhs\" (UniqueName: \"kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.854044 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.854023 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.854114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.854023 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.854114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.854092 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.854326 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.854304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.855681 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.855657 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.855768 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.855702 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.863070 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.863051 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnhs\" (UniqueName: \"kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs\") pod \"console-5556d4f6b8-w9p24\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:27.884956 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:27.884916 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:28.018185 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:28.018133 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:46:28.020681 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:46:28.020654 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a8ddd6_c3ef_49c9_9470_bbe143ce28f8.slice/crio-b46809ddf3440e258c377d572d471c4e1f1706586155be54166c51d09bc2f667 WatchSource:0}: Error finding container b46809ddf3440e258c377d572d471c4e1f1706586155be54166c51d09bc2f667: Status 404 returned error can't find the container with id b46809ddf3440e258c377d572d471c4e1f1706586155be54166c51d09bc2f667 May 27 17:46:28.846399 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:28.846359 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556d4f6b8-w9p24" event={"ID":"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8","Type":"ContainerStarted","Data":"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571"} May 27 17:46:28.846399 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:28.846396 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556d4f6b8-w9p24" event={"ID":"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8","Type":"ContainerStarted","Data":"b46809ddf3440e258c377d572d471c4e1f1706586155be54166c51d09bc2f667"} May 27 17:46:28.870475 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:28.870427 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5556d4f6b8-w9p24" podStartSLOduration=1.870411056 podStartE2EDuration="1.870411056s" podCreationTimestamp="2026-05-27 17:46:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:46:28.869247336 +0000 UTC m=+191.305579388" watchObservedRunningTime="2026-05-27 17:46:28.870411056 +0000 UTC m=+191.306743108" May 27 17:46:37.885928 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:37.885891 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:37.886431 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:37.885986 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:37.891085 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:37.891064 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:38.879660 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:38.879634 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:46:38.931162 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:46:38.931127 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:47:03.956311 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:03.956265 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-766698cd96-gkmw6" podUID="819e54ac-1724-49d8-a308-4122207d7ef0" containerName="console" containerID="cri-o://e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3" gracePeriod=15 May 27 17:47:04.193420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.193393 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766698cd96-gkmw6_819e54ac-1724-49d8-a308-4122207d7ef0/console/0.log" May 27 17:47:04.193531 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.193467 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:47:04.342307 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342221 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342307 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342276 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342504 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342354 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342504 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342379 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342504 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342424 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342504 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342484 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342508 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzd8l\" (UniqueName: \"kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l\") pod \"819e54ac-1724-49d8-a308-4122207d7ef0\" (UID: \"819e54ac-1724-49d8-a308-4122207d7ef0\") " May 27 17:47:04.342802 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342771 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca" (OuterVolumeSpecName: "service-ca") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:47:04.342989 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342830 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:47:04.343162 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.342888 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config" (OuterVolumeSpecName: "console-config") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:47:04.343318 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.343282 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:47:04.345127 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.345098 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:47:04.345221 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.345198 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:47:04.345372 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.345353 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l" (OuterVolumeSpecName: "kube-api-access-pzd8l") pod "819e54ac-1724-49d8-a308-4122207d7ef0" (UID: "819e54ac-1724-49d8-a308-4122207d7ef0"). InnerVolumeSpecName "kube-api-access-pzd8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:47:04.443530 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443497 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443530 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443524 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443530 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443535 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443544 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819e54ac-1724-49d8-a308-4122207d7ef0-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443574 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzd8l\" (UniqueName: \"kubernetes.io/projected/819e54ac-1724-49d8-a308-4122207d7ef0-kube-api-access-pzd8l\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443584 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.443771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.443593 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819e54ac-1724-49d8-a308-4122207d7ef0-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:47:04.943573 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766698cd96-gkmw6_819e54ac-1724-49d8-a308-4122207d7ef0/console/0.log" May 27 17:47:04.943741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943577 2552 generic.go:358] "Generic (PLEG): container finished" podID="819e54ac-1724-49d8-a308-4122207d7ef0" containerID="e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3" exitCode=2 May 27 17:47:04.943741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943649 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766698cd96-gkmw6" May 27 17:47:04.943741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943674 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766698cd96-gkmw6" event={"ID":"819e54ac-1724-49d8-a308-4122207d7ef0","Type":"ContainerDied","Data":"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3"} May 27 17:47:04.943741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943717 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766698cd96-gkmw6" event={"ID":"819e54ac-1724-49d8-a308-4122207d7ef0","Type":"ContainerDied","Data":"02f7a0ab3794fcb2d770540acb481cd21842f2f7c1777627ce4f0083477c1458"} May 27 17:47:04.943741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.943737 2552 scope.go:117] "RemoveContainer" containerID="e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3" May 27 17:47:04.952375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.952356 2552 scope.go:117] "RemoveContainer" containerID="e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3" May 27 17:47:04.952626 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:47:04.952609 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3\": container with ID starting with e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3 not found: ID does not exist" containerID="e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3" May 27 17:47:04.952672 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.952635 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3"} err="failed to get container status \"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3\": rpc error: code = NotFound desc = could not find container \"e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3\": container with ID starting with e519598be71d0286ffa03fa7e905f18c665e63af4652e5c93b46a77834dd4da3 not found: ID does not exist" May 27 17:47:04.966382 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.966352 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:47:04.972581 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:04.972538 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766698cd96-gkmw6"] May 27 17:47:06.209204 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:06.209170 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819e54ac-1724-49d8-a308-4122207d7ef0" path="/var/lib/kubelet/pods/819e54ac-1724-49d8-a308-4122207d7ef0/volumes" May 27 17:47:36.871455 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.871421 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:47:36.871894 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.871710 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819e54ac-1724-49d8-a308-4122207d7ef0" containerName="console" May 27 17:47:36.871894 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.871722 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="819e54ac-1724-49d8-a308-4122207d7ef0" containerName="console" May 27 17:47:36.871894 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.871779 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="819e54ac-1724-49d8-a308-4122207d7ef0" containerName="console" May 27 17:47:36.875865 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.875845 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.891229 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.891207 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:47:36.998228 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998228 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998262 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998325 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998452 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998432 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5k7h\" (UniqueName: \"kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:36.998627 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:36.998456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099246 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099212 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5k7h\" (UniqueName: \"kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099246 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099248 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099378 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099418 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099596 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099455 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099596 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099487 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.099596 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.099526 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.100181 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.100160 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.100291 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.100193 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.100291 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.100198 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.100443 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.100419 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.101820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.101801 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.101951 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.101934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.109176 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.109156 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5k7h\" (UniqueName: \"kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h\") pod \"console-745f556cd7-tskps\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.185123 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.185046 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:37.325197 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:37.325160 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:47:37.332849 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:47:37.332820 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46a94dc_a8c3_468e_9d3e_cba781462c30.slice/crio-801dfeefb98fe7968aeb60b6798b1aee0855d88ac12d6e4c7460f32e4d4d0068 WatchSource:0}: Error finding container 801dfeefb98fe7968aeb60b6798b1aee0855d88ac12d6e4c7460f32e4d4d0068: Status 404 returned error can't find the container with id 801dfeefb98fe7968aeb60b6798b1aee0855d88ac12d6e4c7460f32e4d4d0068 May 27 17:47:38.043623 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:38.043588 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f556cd7-tskps" event={"ID":"a46a94dc-a8c3-468e-9d3e-cba781462c30","Type":"ContainerStarted","Data":"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c"} May 27 17:47:38.043623 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:38.043624 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f556cd7-tskps" event={"ID":"a46a94dc-a8c3-468e-9d3e-cba781462c30","Type":"ContainerStarted","Data":"801dfeefb98fe7968aeb60b6798b1aee0855d88ac12d6e4c7460f32e4d4d0068"} May 27 17:47:38.066411 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:38.066271 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-745f556cd7-tskps" podStartSLOduration=2.066253415 podStartE2EDuration="2.066253415s" podCreationTimestamp="2026-05-27 17:47:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:47:38.065474518 +0000 UTC m=+260.501806570" watchObservedRunningTime="2026-05-27 17:47:38.066253415 +0000 UTC m=+260.502585468" May 27 17:47:47.185809 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:47.185768 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:47.185809 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:47.185808 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:47.190389 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:47.190366 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:48.073063 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:48.073036 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745f556cd7-tskps" May 27 17:47:48.123200 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:47:48.123172 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:48:13.143169 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.143134 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5556d4f6b8-w9p24" podUID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" containerName="console" containerID="cri-o://9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571" gracePeriod=15 May 27 17:48:13.376010 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.375989 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5556d4f6b8-w9p24_f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8/console/0.log" May 27 17:48:13.376128 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.376051 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:48:13.463577 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463471 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.463577 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463546 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.463803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463587 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.463803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463614 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.463803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463630 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.463803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463775 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wnhs\" (UniqueName: \"kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.464069 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.463819 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config\") pod \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\" (UID: \"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8\") " May 27 17:48:13.464069 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464006 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:48:13.464069 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464012 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:48:13.464204 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464090 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.464204 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464110 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.464267 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464205 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config" (OuterVolumeSpecName: "console-config") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:48:13.464373 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.464350 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:48:13.465823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.465791 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:48:13.465823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.465801 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:48:13.465959 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.465834 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs" (OuterVolumeSpecName: "kube-api-access-2wnhs") pod "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" (UID: "f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8"). InnerVolumeSpecName "kube-api-access-2wnhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:48:13.564663 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.564631 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.564663 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.564659 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.564663 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.564668 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.564868 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.564678 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wnhs\" (UniqueName: \"kubernetes.io/projected/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-kube-api-access-2wnhs\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:13.564868 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:13.564687 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:14.137843 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137818 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5556d4f6b8-w9p24_f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8/console/0.log" May 27 17:48:14.137990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137859 2552 generic.go:358] "Generic (PLEG): container finished" podID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" containerID="9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571" exitCode=2 May 27 17:48:14.137990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137926 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556d4f6b8-w9p24" May 27 17:48:14.137990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137939 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556d4f6b8-w9p24" event={"ID":"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8","Type":"ContainerDied","Data":"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571"} May 27 17:48:14.137990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137968 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556d4f6b8-w9p24" event={"ID":"f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8","Type":"ContainerDied","Data":"b46809ddf3440e258c377d572d471c4e1f1706586155be54166c51d09bc2f667"} May 27 17:48:14.137990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.137983 2552 scope.go:117] "RemoveContainer" containerID="9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571" May 27 17:48:14.146578 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.146398 2552 scope.go:117] "RemoveContainer" containerID="9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571" May 27 17:48:14.146810 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:48:14.146686 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571\": container with ID starting with 9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571 not found: ID does not exist" containerID="9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571" May 27 17:48:14.146810 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.146717 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571"} err="failed to get container status \"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571\": rpc error: code = NotFound desc = could not find container \"9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571\": container with ID starting with 9df13779a9546a7314135c8d20bbedb8385ff180e3e29e55093d0997ebec1571 not found: ID does not exist" May 27 17:48:14.159678 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.159652 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:48:14.164216 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.164194 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5556d4f6b8-w9p24"] May 27 17:48:14.209824 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:14.209794 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" path="/var/lib/kubelet/pods/f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8/volumes" May 27 17:48:18.086169 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:18.086146 2552 kubelet.go:1628] "Image garbage collection succeeded" May 27 17:48:29.018281 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.018244 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw"] May 27 17:48:29.020537 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.018530 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" containerName="console" May 27 17:48:29.020537 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.018543 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" containerName="console" May 27 17:48:29.020537 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.018615 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a8ddd6-c3ef-49c9-9470-bbe143ce28f8" containerName="console" May 27 17:48:29.021439 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.021423 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.024244 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.024219 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:48:29.025365 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.025345 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:48:29.025365 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.025353 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:48:29.030933 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.030911 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw"] May 27 17:48:29.088380 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.088349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.088524 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.088400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.088524 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.088441 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4sc\" (UniqueName: \"kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.189281 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.189250 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.189420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.189298 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.189504 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.189481 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4sc\" (UniqueName: \"kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.189694 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.189677 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.189793 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.189698 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.198741 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.198722 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4sc\" (UniqueName: \"kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.330497 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.330413 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:29.458171 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.458137 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw"] May 27 17:48:29.461165 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:48:29.461133 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e68bfc_aefe_4562_ae5f_a959a27b66ef.slice/crio-02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e WatchSource:0}: Error finding container 02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e: Status 404 returned error can't find the container with id 02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e May 27 17:48:29.462903 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:29.462888 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:48:30.184959 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:30.184909 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" event={"ID":"c5e68bfc-aefe-4562-ae5f-a959a27b66ef","Type":"ContainerStarted","Data":"02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e"} May 27 17:48:35.200601 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:35.200550 2552 generic.go:358] "Generic (PLEG): container finished" podID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerID="09f3ac0133dc8f799115e9fdd18dfd392379942d1880a46e1a158ca999f09be7" exitCode=0 May 27 17:48:35.201001 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:35.200629 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" event={"ID":"c5e68bfc-aefe-4562-ae5f-a959a27b66ef","Type":"ContainerDied","Data":"09f3ac0133dc8f799115e9fdd18dfd392379942d1880a46e1a158ca999f09be7"} May 27 17:48:38.210867 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:38.210835 2552 generic.go:358] "Generic (PLEG): container finished" podID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerID="997c8e16f761c223920db90adfcaebe85197c55987d267fb37e6789c842cdf4e" exitCode=0 May 27 17:48:38.211343 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:38.210914 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" event={"ID":"c5e68bfc-aefe-4562-ae5f-a959a27b66ef","Type":"ContainerDied","Data":"997c8e16f761c223920db90adfcaebe85197c55987d267fb37e6789c842cdf4e"} May 27 17:48:46.236580 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:46.236465 2552 generic.go:358] "Generic (PLEG): container finished" podID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerID="2262e29ba59ca18a3f9321c9e40124505918fae3ef447c2c7ab2bcbf16f6134b" exitCode=0 May 27 17:48:46.236580 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:46.236532 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" event={"ID":"c5e68bfc-aefe-4562-ae5f-a959a27b66ef","Type":"ContainerDied","Data":"2262e29ba59ca18a3f9321c9e40124505918fae3ef447c2c7ab2bcbf16f6134b"} May 27 17:48:47.366596 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.366573 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:47.460258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.460223 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle\") pod \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " May 27 17:48:47.460429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.460280 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util\") pod \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " May 27 17:48:47.460429 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.460312 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds4sc\" (UniqueName: \"kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc\") pod \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\" (UID: \"c5e68bfc-aefe-4562-ae5f-a959a27b66ef\") " May 27 17:48:47.460904 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.460877 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle" (OuterVolumeSpecName: "bundle") pod "c5e68bfc-aefe-4562-ae5f-a959a27b66ef" (UID: "c5e68bfc-aefe-4562-ae5f-a959a27b66ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:48:47.462541 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.462518 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc" (OuterVolumeSpecName: "kube-api-access-ds4sc") pod "c5e68bfc-aefe-4562-ae5f-a959a27b66ef" (UID: "c5e68bfc-aefe-4562-ae5f-a959a27b66ef"). InnerVolumeSpecName "kube-api-access-ds4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:48:47.464859 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.464836 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util" (OuterVolumeSpecName: "util") pod "c5e68bfc-aefe-4562-ae5f-a959a27b66ef" (UID: "c5e68bfc-aefe-4562-ae5f-a959a27b66ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:48:47.561103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.561024 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:47.561103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.561053 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds4sc\" (UniqueName: \"kubernetes.io/projected/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-kube-api-access-ds4sc\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:47.561103 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:47.561063 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5e68bfc-aefe-4562-ae5f-a959a27b66ef-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:48:48.242926 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:48.242896 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" event={"ID":"c5e68bfc-aefe-4562-ae5f-a959a27b66ef","Type":"ContainerDied","Data":"02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e"} May 27 17:48:48.242926 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:48.242925 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02df62bf02bd6bc1089e0a361240cd75e5e53ae5dfc96b9a7de8b201ca34992e" May 27 17:48:48.243102 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:48.242948 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dblhbw" May 27 17:48:52.132085 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132046 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s"] May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132388 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="pull" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132401 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="pull" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132409 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="util" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132414 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="util" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132420 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="extract" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132426 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="extract" May 27 17:48:52.132474 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.132470 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5e68bfc-aefe-4562-ae5f-a959a27b66ef" containerName="extract" May 27 17:48:52.165700 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.165665 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s"] May 27 17:48:52.165836 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.165788 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.168620 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.168598 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 17:48:52.168757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.168630 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hmkhf\"" May 27 17:48:52.168757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.168599 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 17:48:52.201444 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.201422 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663a0c0d-66cd-4420-ab0c-c6715fd8d823-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.201589 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.201452 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8g8\" (UniqueName: \"kubernetes.io/projected/663a0c0d-66cd-4420-ab0c-c6715fd8d823-kube-api-access-gn8g8\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.302579 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.302525 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8g8\" (UniqueName: \"kubernetes.io/projected/663a0c0d-66cd-4420-ab0c-c6715fd8d823-kube-api-access-gn8g8\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.302743 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.302648 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663a0c0d-66cd-4420-ab0c-c6715fd8d823-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.303010 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.302989 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663a0c0d-66cd-4420-ab0c-c6715fd8d823-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.320262 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.320235 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8g8\" (UniqueName: \"kubernetes.io/projected/663a0c0d-66cd-4420-ab0c-c6715fd8d823-kube-api-access-gn8g8\") pod \"cert-manager-operator-controller-manager-54b9655956-zq85s\" (UID: \"663a0c0d-66cd-4420-ab0c-c6715fd8d823\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.475384 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.475303 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" May 27 17:48:52.628670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:52.628626 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s"] May 27 17:48:52.631640 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:48:52.631612 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663a0c0d_66cd_4420_ab0c_c6715fd8d823.slice/crio-a708276b062ec2562688266fd77bbe6d320b4010b063ea46922b3f858e86f067 WatchSource:0}: Error finding container a708276b062ec2562688266fd77bbe6d320b4010b063ea46922b3f858e86f067: Status 404 returned error can't find the container with id a708276b062ec2562688266fd77bbe6d320b4010b063ea46922b3f858e86f067 May 27 17:48:53.257746 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:53.257709 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" event={"ID":"663a0c0d-66cd-4420-ab0c-c6715fd8d823","Type":"ContainerStarted","Data":"a708276b062ec2562688266fd77bbe6d320b4010b063ea46922b3f858e86f067"} May 27 17:48:58.274337 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:58.274298 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" event={"ID":"663a0c0d-66cd-4420-ab0c-c6715fd8d823","Type":"ContainerStarted","Data":"598e0800cbc897b0550215643375b3109d73d811c64d650ccd6aa69ea0eae2a2"} May 27 17:48:58.314538 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:48:58.311138 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zq85s" podStartSLOduration=1.719563116 podStartE2EDuration="6.311120651s" podCreationTimestamp="2026-05-27 17:48:52 +0000 UTC" firstStartedPulling="2026-05-27 17:48:52.635247776 +0000 UTC m=+335.071579805" lastFinishedPulling="2026-05-27 17:48:57.226805311 +0000 UTC m=+339.663137340" observedRunningTime="2026-05-27 17:48:58.307804177 +0000 UTC m=+340.744136241" watchObservedRunningTime="2026-05-27 17:48:58.311120651 +0000 UTC m=+340.747452704" May 27 17:49:00.728438 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.728398 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95"] May 27 17:49:00.731871 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.731854 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.734518 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.734495 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:49:00.734653 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.734503 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:49:00.735420 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.735403 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:49:00.743005 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.742986 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95"] May 27 17:49:00.878781 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.878748 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.878962 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.878800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvb9k\" (UniqueName: \"kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.878962 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.878921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.980195 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.980110 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.980195 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.980159 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.980195 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.980190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvb9k\" (UniqueName: \"kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.980518 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.980495 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.980578 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.980522 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:00.988608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:00.988584 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvb9k\" (UniqueName: \"kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:01.040751 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:01.040721 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:01.170675 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:01.170635 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95"] May 27 17:49:01.173337 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:01.173299 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb73e374_9922_4a5e_a099_519f10c95b09.slice/crio-d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9 WatchSource:0}: Error finding container d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9: Status 404 returned error can't find the container with id d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9 May 27 17:49:01.285063 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:01.285035 2552 generic.go:358] "Generic (PLEG): container finished" podID="cb73e374-9922-4a5e-a099-519f10c95b09" containerID="9dcd91ea7ab67192e99860467d864ced1d2b695b714e4826f4ef3181b0e890c9" exitCode=0 May 27 17:49:01.285207 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:01.285086 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" event={"ID":"cb73e374-9922-4a5e-a099-519f10c95b09","Type":"ContainerDied","Data":"9dcd91ea7ab67192e99860467d864ced1d2b695b714e4826f4ef3181b0e890c9"} May 27 17:49:01.285207 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:01.285108 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" event={"ID":"cb73e374-9922-4a5e-a099-519f10c95b09","Type":"ContainerStarted","Data":"d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9"} May 27 17:49:02.126778 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.126738 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tg24k"] May 27 17:49:02.129908 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.129891 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.132610 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.132586 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 17:49:02.133585 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.133551 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zxcwc\"" May 27 17:49:02.133705 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.133566 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 17:49:02.139372 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.139349 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tg24k"] May 27 17:49:02.190529 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.190498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjc4\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-kube-api-access-jrjc4\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.190668 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.190535 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.291513 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.291426 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjc4\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-kube-api-access-jrjc4\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.291513 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.291470 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.303884 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.303855 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.305390 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.305373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjc4\" (UniqueName: \"kubernetes.io/projected/289e493a-7ac9-4d24-ab42-c87ca1a6bc90-kube-api-access-jrjc4\") pod \"cert-manager-webhook-587ccfb98-tg24k\" (UID: \"289e493a-7ac9-4d24-ab42-c87ca1a6bc90\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.452337 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.452306 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:02.576436 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:02.576342 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tg24k"] May 27 17:49:02.580046 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:02.580009 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod289e493a_7ac9_4d24_ab42_c87ca1a6bc90.slice/crio-b65f3891f6b37172432d1f8f201e38d84d0d213b1745342b256f6a13a5c9c29a WatchSource:0}: Error finding container b65f3891f6b37172432d1f8f201e38d84d0d213b1745342b256f6a13a5c9c29a: Status 404 returned error can't find the container with id b65f3891f6b37172432d1f8f201e38d84d0d213b1745342b256f6a13a5c9c29a May 27 17:49:03.293576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.293531 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" event={"ID":"289e493a-7ac9-4d24-ab42-c87ca1a6bc90","Type":"ContainerStarted","Data":"b65f3891f6b37172432d1f8f201e38d84d0d213b1745342b256f6a13a5c9c29a"} May 27 17:49:03.800498 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.800462 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wlbxm"] May 27 17:49:03.804190 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.804155 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:03.807047 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.807019 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wpswb\"" May 27 17:49:03.819641 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.819602 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wlbxm"] May 27 17:49:03.904837 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.904790 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wgr9\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-kube-api-access-7wgr9\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:03.904986 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:03.904857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:04.005512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:04.005474 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wgr9\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-kube-api-access-7wgr9\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:04.005707 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:04.005538 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:04.015270 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:04.015239 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:04.015595 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:04.015568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wgr9\" (UniqueName: \"kubernetes.io/projected/0059aa60-5c6e-4e41-9422-2b6fcc999622-kube-api-access-7wgr9\") pod \"cert-manager-cainjector-68b757865b-wlbxm\" (UID: \"0059aa60-5c6e-4e41-9422-2b6fcc999622\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:04.128796 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:04.128752 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" May 27 17:49:05.679857 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:05.679832 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wlbxm"] May 27 17:49:05.682610 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:05.682581 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0059aa60_5c6e_4e41_9422_2b6fcc999622.slice/crio-42a3ff601e3c589d286538839abcdb3439c3db54d1d1e40098490b7cea58122b WatchSource:0}: Error finding container 42a3ff601e3c589d286538839abcdb3439c3db54d1d1e40098490b7cea58122b: Status 404 returned error can't find the container with id 42a3ff601e3c589d286538839abcdb3439c3db54d1d1e40098490b7cea58122b May 27 17:49:06.307396 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.307358 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" event={"ID":"0059aa60-5c6e-4e41-9422-2b6fcc999622","Type":"ContainerStarted","Data":"f2557b20ed10ce4688968b5a57741884f963bb88e6b9f7465031e55ebf5feedb"} May 27 17:49:06.307396 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.307398 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" event={"ID":"0059aa60-5c6e-4e41-9422-2b6fcc999622","Type":"ContainerStarted","Data":"42a3ff601e3c589d286538839abcdb3439c3db54d1d1e40098490b7cea58122b"} May 27 17:49:06.309010 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.308989 2552 generic.go:358] "Generic (PLEG): container finished" podID="cb73e374-9922-4a5e-a099-519f10c95b09" containerID="203ba219ae261806b2cf8399f733230b39117b9dd8f05ad2bd0cd2e2af929dff" exitCode=0 May 27 17:49:06.309139 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.309051 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" event={"ID":"cb73e374-9922-4a5e-a099-519f10c95b09","Type":"ContainerDied","Data":"203ba219ae261806b2cf8399f733230b39117b9dd8f05ad2bd0cd2e2af929dff"} May 27 17:49:06.310377 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.310357 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" event={"ID":"289e493a-7ac9-4d24-ab42-c87ca1a6bc90","Type":"ContainerStarted","Data":"36656986a5c881ba94e5673f43b1449846adbc8509f695a67cda535e6ee17854"} May 27 17:49:06.310503 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.310492 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:06.327362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.327324 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-wlbxm" podStartSLOduration=3.327312171 podStartE2EDuration="3.327312171s" podCreationTimestamp="2026-05-27 17:49:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:49:06.326495983 +0000 UTC m=+348.762828034" watchObservedRunningTime="2026-05-27 17:49:06.327312171 +0000 UTC m=+348.763644223" May 27 17:49:06.368847 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:06.368105 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" podStartSLOduration=1.401374927 podStartE2EDuration="4.368083881s" podCreationTimestamp="2026-05-27 17:49:02 +0000 UTC" firstStartedPulling="2026-05-27 17:49:02.581893109 +0000 UTC m=+345.018225139" lastFinishedPulling="2026-05-27 17:49:05.548602055 +0000 UTC m=+347.984934093" observedRunningTime="2026-05-27 17:49:06.36549373 +0000 UTC m=+348.801825785" watchObservedRunningTime="2026-05-27 17:49:06.368083881 +0000 UTC m=+348.804415938" May 27 17:49:07.314961 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:07.314923 2552 generic.go:358] "Generic (PLEG): container finished" podID="cb73e374-9922-4a5e-a099-519f10c95b09" containerID="ad940cb7d5442f5c06e0cf2a9d0ac9a72452149f3088b1aff8e968e54b1a0768" exitCode=0 May 27 17:49:07.315402 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:07.315008 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" event={"ID":"cb73e374-9922-4a5e-a099-519f10c95b09","Type":"ContainerDied","Data":"ad940cb7d5442f5c06e0cf2a9d0ac9a72452149f3088b1aff8e968e54b1a0768"} May 27 17:49:08.440544 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.440518 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:08.542341 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.542307 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvb9k\" (UniqueName: \"kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k\") pod \"cb73e374-9922-4a5e-a099-519f10c95b09\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " May 27 17:49:08.542341 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.542344 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util\") pod \"cb73e374-9922-4a5e-a099-519f10c95b09\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " May 27 17:49:08.542548 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.542389 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle\") pod \"cb73e374-9922-4a5e-a099-519f10c95b09\" (UID: \"cb73e374-9922-4a5e-a099-519f10c95b09\") " May 27 17:49:08.542878 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.542840 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle" (OuterVolumeSpecName: "bundle") pod "cb73e374-9922-4a5e-a099-519f10c95b09" (UID: "cb73e374-9922-4a5e-a099-519f10c95b09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:08.544472 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.544452 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k" (OuterVolumeSpecName: "kube-api-access-xvb9k") pod "cb73e374-9922-4a5e-a099-519f10c95b09" (UID: "cb73e374-9922-4a5e-a099-519f10c95b09"). InnerVolumeSpecName "kube-api-access-xvb9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:49:08.547089 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.547055 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util" (OuterVolumeSpecName: "util") pod "cb73e374-9922-4a5e-a099-519f10c95b09" (UID: "cb73e374-9922-4a5e-a099-519f10c95b09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:08.643525 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.643495 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvb9k\" (UniqueName: \"kubernetes.io/projected/cb73e374-9922-4a5e-a099-519f10c95b09-kube-api-access-xvb9k\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:08.643525 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.643523 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:08.643715 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:08.643534 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb73e374-9922-4a5e-a099-519f10c95b09-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:09.322730 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:09.322686 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" event={"ID":"cb73e374-9922-4a5e-a099-519f10c95b09","Type":"ContainerDied","Data":"d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9"} May 27 17:49:09.322730 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:09.322731 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24m95" May 27 17:49:09.322730 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:09.322733 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d90c0ac31d62090bdb3a905c6f5c49a463beb952fb317bef783fc2a0218ca4d9" May 27 17:49:10.706432 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706398 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6s9zv"] May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706712 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="extract" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706726 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="extract" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706742 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="util" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706748 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="util" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706766 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="pull" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706771 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="pull" May 27 17:49:10.706820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.706818 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb73e374-9922-4a5e-a099-519f10c95b09" containerName="extract" May 27 17:49:10.709945 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.709930 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.712818 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.712799 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-58qq8\"" May 27 17:49:10.717906 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.717888 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6s9zv"] May 27 17:49:10.862050 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.862011 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-bound-sa-token\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.862245 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.862068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l2vb\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-kube-api-access-2l2vb\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.963141 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.963052 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-bound-sa-token\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.963141 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.963100 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l2vb\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-kube-api-access-2l2vb\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.972202 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.972171 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-bound-sa-token\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:10.972330 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:10.972182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l2vb\" (UniqueName: \"kubernetes.io/projected/ac69880e-cb7d-4420-a44a-5aa63bd0edf2-kube-api-access-2l2vb\") pod \"cert-manager-79c8d999ff-6s9zv\" (UID: \"ac69880e-cb7d-4420-a44a-5aa63bd0edf2\") " pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:11.019988 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:11.019958 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6s9zv" May 27 17:49:11.145426 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:11.145385 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6s9zv"] May 27 17:49:11.148045 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:11.148017 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac69880e_cb7d_4420_a44a_5aa63bd0edf2.slice/crio-ff0632fe1d551e3fd0c5ba2e666bacfea210cce8f24631e67b06142be50867e6 WatchSource:0}: Error finding container ff0632fe1d551e3fd0c5ba2e666bacfea210cce8f24631e67b06142be50867e6: Status 404 returned error can't find the container with id ff0632fe1d551e3fd0c5ba2e666bacfea210cce8f24631e67b06142be50867e6 May 27 17:49:11.330375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:11.330281 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6s9zv" event={"ID":"ac69880e-cb7d-4420-a44a-5aa63bd0edf2","Type":"ContainerStarted","Data":"4d581ddb8cfcd4a4f039b88f41e0a2b38cdee28cfae6261649b4ca65fc8cfca2"} May 27 17:49:11.330375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:11.330319 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6s9zv" event={"ID":"ac69880e-cb7d-4420-a44a-5aa63bd0edf2","Type":"ContainerStarted","Data":"ff0632fe1d551e3fd0c5ba2e666bacfea210cce8f24631e67b06142be50867e6"} May 27 17:49:11.360143 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:11.360096 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-6s9zv" podStartSLOduration=1.360082726 podStartE2EDuration="1.360082726s" podCreationTimestamp="2026-05-27 17:49:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:49:11.358107593 +0000 UTC m=+353.794439646" watchObservedRunningTime="2026-05-27 17:49:11.360082726 +0000 UTC m=+353.796414778" May 27 17:49:12.317413 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:12.317378 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tg24k" May 27 17:49:16.359600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.359542 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb"] May 27 17:49:16.369538 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.369513 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.371712 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.371683 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb"] May 27 17:49:16.372191 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.372168 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 17:49:16.372292 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.372231 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 17:49:16.373234 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.373213 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-89zsb\"" May 27 17:49:16.511705 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.511667 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5367a03-085a-47e5-ba67-93f2c0027bd2-tmp\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.511886 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.511777 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc22p\" (UniqueName: \"kubernetes.io/projected/c5367a03-085a-47e5-ba67-93f2c0027bd2-kube-api-access-mc22p\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.612467 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.612389 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mc22p\" (UniqueName: \"kubernetes.io/projected/c5367a03-085a-47e5-ba67-93f2c0027bd2-kube-api-access-mc22p\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.612467 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.612447 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5367a03-085a-47e5-ba67-93f2c0027bd2-tmp\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.612813 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.612797 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5367a03-085a-47e5-ba67-93f2c0027bd2-tmp\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.621954 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.621929 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc22p\" (UniqueName: \"kubernetes.io/projected/c5367a03-085a-47e5-ba67-93f2c0027bd2-kube-api-access-mc22p\") pod \"openshift-lws-operator-bfc7f696d-q9xgb\" (UID: \"c5367a03-085a-47e5-ba67-93f2c0027bd2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.679910 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.679878 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" May 27 17:49:16.803759 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:16.803728 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb"] May 27 17:49:16.806755 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:16.806719 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5367a03_085a_47e5_ba67_93f2c0027bd2.slice/crio-a098fd1c146bbf3cbd9f3adcf890bdd857d9375ee731606fe4d477d6c41add20 WatchSource:0}: Error finding container a098fd1c146bbf3cbd9f3adcf890bdd857d9375ee731606fe4d477d6c41add20: Status 404 returned error can't find the container with id a098fd1c146bbf3cbd9f3adcf890bdd857d9375ee731606fe4d477d6c41add20 May 27 17:49:17.350292 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:17.350256 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" event={"ID":"c5367a03-085a-47e5-ba67-93f2c0027bd2","Type":"ContainerStarted","Data":"a098fd1c146bbf3cbd9f3adcf890bdd857d9375ee731606fe4d477d6c41add20"} May 27 17:49:19.363737 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:19.363701 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" event={"ID":"c5367a03-085a-47e5-ba67-93f2c0027bd2","Type":"ContainerStarted","Data":"234af4248ed50e1ef8ae33c07d826027336f4478e43bd9bbdd154d8ca68cd2c3"} May 27 17:49:19.382551 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:19.382493 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-q9xgb" podStartSLOduration=1.363165034 podStartE2EDuration="3.382476298s" podCreationTimestamp="2026-05-27 17:49:16 +0000 UTC" firstStartedPulling="2026-05-27 17:49:16.80831086 +0000 UTC m=+359.244642899" lastFinishedPulling="2026-05-27 17:49:18.827622133 +0000 UTC m=+361.263954163" observedRunningTime="2026-05-27 17:49:19.381832878 +0000 UTC m=+361.818164932" watchObservedRunningTime="2026-05-27 17:49:19.382476298 +0000 UTC m=+361.818808351" May 27 17:49:21.698512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.698474 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc"] May 27 17:49:21.702067 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.702049 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.704858 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.704841 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:49:21.704961 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.704945 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:49:21.705932 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.705918 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:49:21.711963 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.711941 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc"] May 27 17:49:21.854580 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.854522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdhm\" (UniqueName: \"kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.854750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.854600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.854750 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.854664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.956124 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.956033 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdhm\" (UniqueName: \"kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.956124 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.956077 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.956347 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.956136 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.956497 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.956477 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.956599 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.956541 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:21.966172 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:21.966146 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdhm\" (UniqueName: \"kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:22.012168 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:22.012133 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:22.138670 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:22.138640 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc"] May 27 17:49:22.141989 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:22.141962 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ec37c_d0cf_40dc_b298_b75f275e1e21.slice/crio-ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9 WatchSource:0}: Error finding container ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9: Status 404 returned error can't find the container with id ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9 May 27 17:49:22.375502 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:22.375470 2552 generic.go:358] "Generic (PLEG): container finished" podID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerID="6e28dec483fc835a803a9684bce98e2e0c56e1f5e474326741e5bcb9fd5c087c" exitCode=0 May 27 17:49:22.375697 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:22.375513 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" event={"ID":"f60ec37c-d0cf-40dc-b298-b75f275e1e21","Type":"ContainerDied","Data":"6e28dec483fc835a803a9684bce98e2e0c56e1f5e474326741e5bcb9fd5c087c"} May 27 17:49:22.375697 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:22.375535 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" event={"ID":"f60ec37c-d0cf-40dc-b298-b75f275e1e21","Type":"ContainerStarted","Data":"ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9"} May 27 17:49:23.379979 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:23.379943 2552 generic.go:358] "Generic (PLEG): container finished" podID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerID="ec02e8f1c671d0bb8ca910d5c6f558232923cd39f8a7698abbb51d2f42c09a8d" exitCode=0 May 27 17:49:23.380472 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:23.380030 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" event={"ID":"f60ec37c-d0cf-40dc-b298-b75f275e1e21","Type":"ContainerDied","Data":"ec02e8f1c671d0bb8ca910d5c6f558232923cd39f8a7698abbb51d2f42c09a8d"} May 27 17:49:24.386214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:24.386167 2552 generic.go:358] "Generic (PLEG): container finished" podID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerID="4963a784ae61513ec60cfe04512b2c984da0d511d1ffb7a1e3a6a71f8f58e5a9" exitCode=0 May 27 17:49:24.386602 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:24.386251 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" event={"ID":"f60ec37c-d0cf-40dc-b298-b75f275e1e21","Type":"ContainerDied","Data":"4963a784ae61513ec60cfe04512b2c984da0d511d1ffb7a1e3a6a71f8f58e5a9"} May 27 17:49:25.514885 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.514862 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:25.581742 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.581712 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util\") pod \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " May 27 17:49:25.581914 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.581779 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle\") pod \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " May 27 17:49:25.581914 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.581812 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqdhm\" (UniqueName: \"kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm\") pod \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\" (UID: \"f60ec37c-d0cf-40dc-b298-b75f275e1e21\") " May 27 17:49:25.582469 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.582398 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle" (OuterVolumeSpecName: "bundle") pod "f60ec37c-d0cf-40dc-b298-b75f275e1e21" (UID: "f60ec37c-d0cf-40dc-b298-b75f275e1e21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:25.584116 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.584081 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm" (OuterVolumeSpecName: "kube-api-access-vqdhm") pod "f60ec37c-d0cf-40dc-b298-b75f275e1e21" (UID: "f60ec37c-d0cf-40dc-b298-b75f275e1e21"). InnerVolumeSpecName "kube-api-access-vqdhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:49:25.587331 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.587290 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util" (OuterVolumeSpecName: "util") pod "f60ec37c-d0cf-40dc-b298-b75f275e1e21" (UID: "f60ec37c-d0cf-40dc-b298-b75f275e1e21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:25.682687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.682573 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:25.682687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.682645 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60ec37c-d0cf-40dc-b298-b75f275e1e21-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:25.682687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:25.682659 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqdhm\" (UniqueName: \"kubernetes.io/projected/f60ec37c-d0cf-40dc-b298-b75f275e1e21-kube-api-access-vqdhm\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:26.395039 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:26.395004 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" event={"ID":"f60ec37c-d0cf-40dc-b298-b75f275e1e21","Type":"ContainerDied","Data":"ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9"} May 27 17:49:26.395039 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:26.395040 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca51621858a6873e8f3323779b56b20c04a4205b70817441182e7b82ca71d1e9" May 27 17:49:26.395039 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:26.395038 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5jq4tc" May 27 17:49:37.869890 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.869854 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb"] May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870172 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="pull" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870184 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="pull" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870208 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="extract" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870213 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="extract" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870221 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="util" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870227 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="util" May 27 17:49:37.870375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.870271 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f60ec37c-d0cf-40dc-b298-b75f275e1e21" containerName="extract" May 27 17:49:37.873772 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.873752 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:37.876609 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.876587 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:49:37.876609 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.876601 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:49:37.876797 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.876619 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:49:37.884018 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.883998 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb"] May 27 17:49:37.977273 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.977230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:37.977273 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.977274 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9spp\" (UniqueName: \"kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:37.977498 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:37.977306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.078710 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.078682 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.078875 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.078716 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9spp\" (UniqueName: \"kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.078875 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.078750 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.079068 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.079048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.079126 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.079108 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.087976 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.087952 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9spp\" (UniqueName: \"kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.183008 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.182929 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:38.318677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.318648 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb"] May 27 17:49:38.320670 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:38.320646 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8ec8fd_f08c_45ae_bc97_89e49efda3f9.slice/crio-0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef WatchSource:0}: Error finding container 0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef: Status 404 returned error can't find the container with id 0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef May 27 17:49:38.435058 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.434993 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" event={"ID":"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9","Type":"ContainerStarted","Data":"0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef"} May 27 17:49:38.830473 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.830395 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb"] May 27 17:49:38.845925 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.845895 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.849897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.849710 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 17:49:38.849897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.849754 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 17:49:38.849897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.849762 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 17:49:38.849897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.849769 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 17:49:38.849897 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.849786 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ngn6g\"" May 27 17:49:38.851674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.851650 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb"] May 27 17:49:38.887815 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.887784 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m25hk\" (UniqueName: \"kubernetes.io/projected/9ec65a0a-9729-4328-95af-7851cf40daa9-kube-api-access-m25hk\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.887815 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.887817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.888191 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.887856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.988230 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.988199 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m25hk\" (UniqueName: \"kubernetes.io/projected/9ec65a0a-9729-4328-95af-7851cf40daa9-kube-api-access-m25hk\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.988230 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.988232 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.988431 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.988262 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.990600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.990569 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.990600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.990593 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ec65a0a-9729-4328-95af-7851cf40daa9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:38.997672 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:38.997649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m25hk\" (UniqueName: \"kubernetes.io/projected/9ec65a0a-9729-4328-95af-7851cf40daa9-kube-api-access-m25hk\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-sztjb\" (UID: \"9ec65a0a-9729-4328-95af-7851cf40daa9\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:39.158035 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:39.158000 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:39.299696 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:39.299668 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb"] May 27 17:49:39.302272 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:39.302243 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec65a0a_9729_4328_95af_7851cf40daa9.slice/crio-0f4951233826434530a75e308a9ca9ccf3ab726edef036d5b570d2fb314f5a7e WatchSource:0}: Error finding container 0f4951233826434530a75e308a9ca9ccf3ab726edef036d5b570d2fb314f5a7e: Status 404 returned error can't find the container with id 0f4951233826434530a75e308a9ca9ccf3ab726edef036d5b570d2fb314f5a7e May 27 17:49:39.440081 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:39.439986 2552 generic.go:358] "Generic (PLEG): container finished" podID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerID="ddfb6fd3c54f07cc23db27f5bfbc4b8456aaf913a60f713d6547fb31bce6f565" exitCode=0 May 27 17:49:39.440081 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:39.440070 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" event={"ID":"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9","Type":"ContainerDied","Data":"ddfb6fd3c54f07cc23db27f5bfbc4b8456aaf913a60f713d6547fb31bce6f565"} May 27 17:49:39.441238 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:39.441217 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" event={"ID":"9ec65a0a-9729-4328-95af-7851cf40daa9","Type":"ContainerStarted","Data":"0f4951233826434530a75e308a9ca9ccf3ab726edef036d5b570d2fb314f5a7e"} May 27 17:49:40.447717 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:40.447619 2552 generic.go:358] "Generic (PLEG): container finished" podID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerID="99e53ee0a449b1edfd61044c411fd2c9115fe076ddaabb8df74815f63dc9cf71" exitCode=0 May 27 17:49:40.447717 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:40.447681 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" event={"ID":"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9","Type":"ContainerDied","Data":"99e53ee0a449b1edfd61044c411fd2c9115fe076ddaabb8df74815f63dc9cf71"} May 27 17:49:41.454710 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:41.454625 2552 generic.go:358] "Generic (PLEG): container finished" podID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerID="1538eb549cf00021c8217973b49210d61801aaed1dd4c2e354d5a492fb09e1c7" exitCode=0 May 27 17:49:41.454710 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:41.454688 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" event={"ID":"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9","Type":"ContainerDied","Data":"1538eb549cf00021c8217973b49210d61801aaed1dd4c2e354d5a492fb09e1c7"} May 27 17:49:42.460405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.460363 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" event={"ID":"9ec65a0a-9729-4328-95af-7851cf40daa9","Type":"ContainerStarted","Data":"f77f037f6abdc64670355b73e8e6e902eeeffc509b44cfad0dcf186e2ac691b7"} May 27 17:49:42.460820 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.460647 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:42.481450 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.481404 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" podStartSLOduration=1.952381154 podStartE2EDuration="4.481388648s" podCreationTimestamp="2026-05-27 17:49:38 +0000 UTC" firstStartedPulling="2026-05-27 17:49:39.304069018 +0000 UTC m=+381.740401048" lastFinishedPulling="2026-05-27 17:49:41.833076508 +0000 UTC m=+384.269408542" observedRunningTime="2026-05-27 17:49:42.48097077 +0000 UTC m=+384.917302823" watchObservedRunningTime="2026-05-27 17:49:42.481388648 +0000 UTC m=+384.917720701" May 27 17:49:42.593870 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.593847 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:42.734649 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.734536 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9spp\" (UniqueName: \"kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp\") pod \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " May 27 17:49:42.734649 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.734606 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle\") pod \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " May 27 17:49:42.734831 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.734667 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util\") pod \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\" (UID: \"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9\") " May 27 17:49:42.735322 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.735292 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle" (OuterVolumeSpecName: "bundle") pod "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" (UID: "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:42.736636 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.736611 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp" (OuterVolumeSpecName: "kube-api-access-d9spp") pod "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" (UID: "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9"). InnerVolumeSpecName "kube-api-access-d9spp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:49:42.740784 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.740748 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util" (OuterVolumeSpecName: "util") pod "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" (UID: "ac8ec8fd-f08c-45ae-bc97-89e49efda3f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:49:42.836045 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.836008 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:42.836045 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.836040 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9spp\" (UniqueName: \"kubernetes.io/projected/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-kube-api-access-d9spp\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:42.836238 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:42.836056 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8ec8fd-f08c-45ae-bc97-89e49efda3f9-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:49:43.470284 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:43.470255 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" May 27 17:49:43.470773 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:43.470253 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9v4qkb" event={"ID":"ac8ec8fd-f08c-45ae-bc97-89e49efda3f9","Type":"ContainerDied","Data":"0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef"} May 27 17:49:43.470773 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:43.470362 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cecda887b7616398cb00ae63b0a3069adcfbe32fab3118d76c3161a3e3998ef" May 27 17:49:44.190184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190146 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8"] May 27 17:49:44.190487 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190474 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="extract" May 27 17:49:44.190533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190488 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="extract" May 27 17:49:44.190533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190506 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="pull" May 27 17:49:44.190533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190512 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="pull" May 27 17:49:44.190533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190526 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="util" May 27 17:49:44.190533 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190531 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="util" May 27 17:49:44.190705 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.190602 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac8ec8fd-f08c-45ae-bc97-89e49efda3f9" containerName="extract" May 27 17:49:44.194910 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.194884 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.197757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.197737 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xmggl\"" May 27 17:49:44.198769 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.198750 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 17:49:44.198893 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.198796 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 17:49:44.198893 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.198855 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 17:49:44.204471 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.204449 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8"] May 27 17:49:44.247743 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.247705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkvcm\" (UniqueName: \"kubernetes.io/projected/ad3df171-64f0-4077-938c-8f17d602d668-kube-api-access-fkvcm\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.247904 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.247751 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.247904 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.247856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-metrics-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.248003 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.247906 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad3df171-64f0-4077-938c-8f17d602d668-manager-config\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.348512 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.348484 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.348724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.348540 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-metrics-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.348724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.348588 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad3df171-64f0-4077-938c-8f17d602d668-manager-config\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.348724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.348615 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkvcm\" (UniqueName: \"kubernetes.io/projected/ad3df171-64f0-4077-938c-8f17d602d668-kube-api-access-fkvcm\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.349254 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.349232 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad3df171-64f0-4077-938c-8f17d602d668-manager-config\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.350771 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.350749 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.350875 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.350851 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad3df171-64f0-4077-938c-8f17d602d668-metrics-cert\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.361137 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.361111 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkvcm\" (UniqueName: \"kubernetes.io/projected/ad3df171-64f0-4077-938c-8f17d602d668-kube-api-access-fkvcm\") pod \"lws-controller-manager-78df8cc544-jmct8\" (UID: \"ad3df171-64f0-4077-938c-8f17d602d668\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.504619 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.504536 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:44.639510 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:44.639483 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8"] May 27 17:49:44.642030 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:44.641994 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3df171_64f0_4077_938c_8f17d602d668.slice/crio-a69eeff78c299021013527b916f33e64985fa5a2f955f6922ac43403b103a068 WatchSource:0}: Error finding container a69eeff78c299021013527b916f33e64985fa5a2f955f6922ac43403b103a068: Status 404 returned error can't find the container with id a69eeff78c299021013527b916f33e64985fa5a2f955f6922ac43403b103a068 May 27 17:49:45.478200 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:45.478159 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" event={"ID":"ad3df171-64f0-4077-938c-8f17d602d668","Type":"ContainerStarted","Data":"a69eeff78c299021013527b916f33e64985fa5a2f955f6922ac43403b103a068"} May 27 17:49:46.482280 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:46.482189 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" event={"ID":"ad3df171-64f0-4077-938c-8f17d602d668","Type":"ContainerStarted","Data":"3b752e39169101c3421c8e3738e6f58f81ad0eb0fd26c82d1f38dd4d3a8b2eae"} May 27 17:49:46.482685 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:46.482285 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:46.501081 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:46.501029 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" podStartSLOduration=0.970834776 podStartE2EDuration="2.50101623s" podCreationTimestamp="2026-05-27 17:49:44 +0000 UTC" firstStartedPulling="2026-05-27 17:49:44.643718459 +0000 UTC m=+387.080050489" lastFinishedPulling="2026-05-27 17:49:46.17389991 +0000 UTC m=+388.610231943" observedRunningTime="2026-05-27 17:49:46.499007308 +0000 UTC m=+388.935339360" watchObservedRunningTime="2026-05-27 17:49:46.50101623 +0000 UTC m=+388.937348281" May 27 17:49:53.472254 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:53.472224 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-sztjb" May 27 17:49:57.487926 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.487895 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-jmct8" May 27 17:49:57.721845 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.721809 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2"] May 27 17:49:57.727321 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.727298 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.731485 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.731454 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:49:57.732159 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.732137 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:49:57.732353 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.732332 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:49:57.737410 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.737379 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2"] May 27 17:49:57.870218 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.870186 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.870437 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.870232 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klp9h\" (UniqueName: \"kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.870437 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.870347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.971137 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.971099 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.971328 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.971144 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klp9h\" (UniqueName: \"kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.971328 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.971188 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.971600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.971580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.971681 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.971582 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:57.980061 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:57.980038 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klp9h\" (UniqueName: \"kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:58.039346 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:58.039312 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:49:58.167786 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:58.167711 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2"] May 27 17:49:58.170931 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:49:58.170890 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a5e2c5_8e80_4c16_8418_172273a60fb2.slice/crio-03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b WatchSource:0}: Error finding container 03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b: Status 404 returned error can't find the container with id 03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b May 27 17:49:58.523059 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:58.522975 2552 generic.go:358] "Generic (PLEG): container finished" podID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerID="c189792c3631211c42ade081002ea8cd546b09a5632eae1a3fc71b88ed83132d" exitCode=0 May 27 17:49:58.523416 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:58.523068 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" event={"ID":"33a5e2c5-8e80-4c16-8418-172273a60fb2","Type":"ContainerDied","Data":"c189792c3631211c42ade081002ea8cd546b09a5632eae1a3fc71b88ed83132d"} May 27 17:49:58.523416 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:49:58.523104 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" event={"ID":"33a5e2c5-8e80-4c16-8418-172273a60fb2","Type":"ContainerStarted","Data":"03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b"} May 27 17:50:00.531955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:00.531912 2552 generic.go:358] "Generic (PLEG): container finished" podID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerID="60027b23a0aae6b456c86629e3d63a400ac377f52f501c5ee3b3e78a6e56ff79" exitCode=0 May 27 17:50:00.532344 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:00.531972 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" event={"ID":"33a5e2c5-8e80-4c16-8418-172273a60fb2","Type":"ContainerDied","Data":"60027b23a0aae6b456c86629e3d63a400ac377f52f501c5ee3b3e78a6e56ff79"} May 27 17:50:01.537618 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:01.537584 2552 generic.go:358] "Generic (PLEG): container finished" podID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerID="e75b6404ec305179e9a8537125e8c71932be0fda109bfb5d7aa99557c81b0ce1" exitCode=0 May 27 17:50:01.538020 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:01.537666 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" event={"ID":"33a5e2c5-8e80-4c16-8418-172273a60fb2","Type":"ContainerDied","Data":"e75b6404ec305179e9a8537125e8c71932be0fda109bfb5d7aa99557c81b0ce1"} May 27 17:50:02.663861 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.663838 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:50:02.815104 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.815012 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle\") pod \"33a5e2c5-8e80-4c16-8418-172273a60fb2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " May 27 17:50:02.815104 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.815049 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klp9h\" (UniqueName: \"kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h\") pod \"33a5e2c5-8e80-4c16-8418-172273a60fb2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " May 27 17:50:02.815302 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.815121 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util\") pod \"33a5e2c5-8e80-4c16-8418-172273a60fb2\" (UID: \"33a5e2c5-8e80-4c16-8418-172273a60fb2\") " May 27 17:50:02.815937 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.815908 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle" (OuterVolumeSpecName: "bundle") pod "33a5e2c5-8e80-4c16-8418-172273a60fb2" (UID: "33a5e2c5-8e80-4c16-8418-172273a60fb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:50:02.817196 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.817160 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h" (OuterVolumeSpecName: "kube-api-access-klp9h") pod "33a5e2c5-8e80-4c16-8418-172273a60fb2" (UID: "33a5e2c5-8e80-4c16-8418-172273a60fb2"). InnerVolumeSpecName "kube-api-access-klp9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:50:02.820592 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.820543 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util" (OuterVolumeSpecName: "util") pod "33a5e2c5-8e80-4c16-8418-172273a60fb2" (UID: "33a5e2c5-8e80-4c16-8418-172273a60fb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:50:02.916653 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.916624 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:02.916653 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.916650 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klp9h\" (UniqueName: \"kubernetes.io/projected/33a5e2c5-8e80-4c16-8418-172273a60fb2-kube-api-access-klp9h\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:02.916653 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:02.916661 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33a5e2c5-8e80-4c16-8418-172273a60fb2-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:03.546854 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:03.546814 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" event={"ID":"33a5e2c5-8e80-4c16-8418-172273a60fb2","Type":"ContainerDied","Data":"03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b"} May 27 17:50:03.546854 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:03.546858 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03bc594d3e7721445557a94c0023d0a5fbacc7a6e33ed836497be1149d6d881b" May 27 17:50:03.547074 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:03.546881 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835jn7h2" May 27 17:50:12.538951 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.538906 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm"] May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539224 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="util" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539234 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="util" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539241 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="extract" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539246 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="extract" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539253 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="pull" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539260 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="pull" May 27 17:50:12.539445 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.539306 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="33a5e2c5-8e80-4c16-8418-172273a60fb2" containerName="extract" May 27 17:50:12.544718 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.544695 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.549347 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.549324 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6gqw\"" May 27 17:50:12.549696 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.549680 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 17:50:12.555380 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.555359 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 17:50:12.558830 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.558801 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm"] May 27 17:50:12.596755 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.596725 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.596905 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.596763 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.596905 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.596866 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whkb6\" (UniqueName: \"kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.697875 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.697841 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.698082 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.697881 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.698082 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.697947 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whkb6\" (UniqueName: \"kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.698214 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.698194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.698283 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.698263 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.714368 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.714342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whkb6\" (UniqueName: \"kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.856178 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.856143 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:12.995779 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:12.995749 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm"] May 27 17:50:12.998102 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:50:12.998075 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f152f33_18ea_4097_913d_ee8c2082d1e6.slice/crio-6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f WatchSource:0}: Error finding container 6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f: Status 404 returned error can't find the container with id 6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f May 27 17:50:13.580177 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:13.580077 2552 generic.go:358] "Generic (PLEG): container finished" podID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerID="6f2475c0bc25cbcc4fc19bfb977dc14e4979cb382ba1bffb5393d2783fb4499b" exitCode=0 May 27 17:50:13.580616 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:13.580171 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" event={"ID":"4f152f33-18ea-4097-913d-ee8c2082d1e6","Type":"ContainerDied","Data":"6f2475c0bc25cbcc4fc19bfb977dc14e4979cb382ba1bffb5393d2783fb4499b"} May 27 17:50:13.580616 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:13.580213 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" event={"ID":"4f152f33-18ea-4097-913d-ee8c2082d1e6","Type":"ContainerStarted","Data":"6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f"} May 27 17:50:14.585093 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:14.585012 2552 generic.go:358] "Generic (PLEG): container finished" podID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerID="513ee03961cefd11364210b5a75d912d66249ad519e81e8e7ca31bfdf453fa8f" exitCode=0 May 27 17:50:14.585483 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:14.585104 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" event={"ID":"4f152f33-18ea-4097-913d-ee8c2082d1e6","Type":"ContainerDied","Data":"513ee03961cefd11364210b5a75d912d66249ad519e81e8e7ca31bfdf453fa8f"} May 27 17:50:15.591380 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:15.591338 2552 generic.go:358] "Generic (PLEG): container finished" podID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerID="614a79171ce1e6bd2ad2bca206af402426c3e7b56936c91ba98986f06a7a4efb" exitCode=0 May 27 17:50:15.591849 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:15.591409 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" event={"ID":"4f152f33-18ea-4097-913d-ee8c2082d1e6","Type":"ContainerDied","Data":"614a79171ce1e6bd2ad2bca206af402426c3e7b56936c91ba98986f06a7a4efb"} May 27 17:50:16.746356 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.746334 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:16.833735 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.833697 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util\") pod \"4f152f33-18ea-4097-913d-ee8c2082d1e6\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " May 27 17:50:16.833909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.833754 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whkb6\" (UniqueName: \"kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6\") pod \"4f152f33-18ea-4097-913d-ee8c2082d1e6\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " May 27 17:50:16.833909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.833799 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle\") pod \"4f152f33-18ea-4097-913d-ee8c2082d1e6\" (UID: \"4f152f33-18ea-4097-913d-ee8c2082d1e6\") " May 27 17:50:16.834688 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.834664 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle" (OuterVolumeSpecName: "bundle") pod "4f152f33-18ea-4097-913d-ee8c2082d1e6" (UID: "4f152f33-18ea-4097-913d-ee8c2082d1e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:50:16.835908 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.835880 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6" (OuterVolumeSpecName: "kube-api-access-whkb6") pod "4f152f33-18ea-4097-913d-ee8c2082d1e6" (UID: "4f152f33-18ea-4097-913d-ee8c2082d1e6"). InnerVolumeSpecName "kube-api-access-whkb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:50:16.839883 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.839842 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util" (OuterVolumeSpecName: "util") pod "4f152f33-18ea-4097-913d-ee8c2082d1e6" (UID: "4f152f33-18ea-4097-913d-ee8c2082d1e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:50:16.935087 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.934998 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:16.935087 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.935030 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whkb6\" (UniqueName: \"kubernetes.io/projected/4f152f33-18ea-4097-913d-ee8c2082d1e6-kube-api-access-whkb6\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:16.935087 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:16.935040 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f152f33-18ea-4097-913d-ee8c2082d1e6-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:50:17.601278 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:17.601248 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" May 27 17:50:17.601451 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:17.601247 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahxcdm" event={"ID":"4f152f33-18ea-4097-913d-ee8c2082d1e6","Type":"ContainerDied","Data":"6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f"} May 27 17:50:17.601451 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:17.601368 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6302d958d6934912c118fe2f4b9924ab1b61bc6e36aa3357ab186320beb6193f" May 27 17:50:49.090956 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.090880 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb"] May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091205 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="util" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091217 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="util" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091240 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="extract" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091260 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="extract" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091269 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="pull" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091274 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="pull" May 27 17:50:49.091387 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.091335 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f152f33-18ea-4097-913d-ee8c2082d1e6" containerName="extract" May 27 17:50:49.096113 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.096093 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.098996 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.098969 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 17:50:49.099136 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.099049 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5whb2\"" May 27 17:50:49.099136 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.099074 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 17:50:49.099430 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.099407 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 17:50:49.105729 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.105694 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb"] May 27 17:50:49.214407 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214607 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214439 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214607 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214490 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214607 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214526 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214607 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214594 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214768 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214768 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214732 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khs8x\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-kube-api-access-khs8x\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214768 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214758 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.214879 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.214781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316004 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.315960 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316019 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khs8x\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-kube-api-access-khs8x\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316050 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316075 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316117 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316177 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316422 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316218 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316422 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316255 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316422 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316404 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316647 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316618 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316737 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316708 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316788 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316749 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316788 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316776 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.316905 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.316886 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.318405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.318389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.318728 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.318707 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.327527 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.324052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.327527 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.324788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khs8x\" (UniqueName: \"kubernetes.io/projected/e52ceff9-d3e7-4bd1-a505-9c961dce15bd-kube-api-access-khs8x\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8vm6bb\" (UID: \"e52ceff9-d3e7-4bd1-a505-9c961dce15bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.409268 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.409231 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:49.545234 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.545205 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb"] May 27 17:50:49.547574 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:50:49.547529 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52ceff9_d3e7_4bd1_a505_9c961dce15bd.slice/crio-40e1e2ff042fa9737ca3d24d2201a94b45deac23db0370b8540e749cef72390a WatchSource:0}: Error finding container 40e1e2ff042fa9737ca3d24d2201a94b45deac23db0370b8540e749cef72390a: Status 404 returned error can't find the container with id 40e1e2ff042fa9737ca3d24d2201a94b45deac23db0370b8540e749cef72390a May 27 17:50:49.719407 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:49.719318 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" event={"ID":"e52ceff9-d3e7-4bd1-a505-9c961dce15bd","Type":"ContainerStarted","Data":"40e1e2ff042fa9737ca3d24d2201a94b45deac23db0370b8540e749cef72390a"} May 27 17:50:51.801506 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:51.801465 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:50:51.801767 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:51.801566 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:50:51.801767 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:51.801598 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:50:52.731357 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:52.731322 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" event={"ID":"e52ceff9-d3e7-4bd1-a505-9c961dce15bd","Type":"ContainerStarted","Data":"fedb3444d56b513fa43be3502c973d790c3965fcbbc098b55cf8c1006313038e"} May 27 17:50:52.754207 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:52.754153 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" podStartSLOduration=1.50227165 podStartE2EDuration="3.754135931s" podCreationTimestamp="2026-05-27 17:50:49 +0000 UTC" firstStartedPulling="2026-05-27 17:50:49.549327416 +0000 UTC m=+451.985659446" lastFinishedPulling="2026-05-27 17:50:51.801191697 +0000 UTC m=+454.237523727" observedRunningTime="2026-05-27 17:50:52.752092579 +0000 UTC m=+455.188424643" watchObservedRunningTime="2026-05-27 17:50:52.754135931 +0000 UTC m=+455.190468060" May 27 17:50:53.409904 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:53.409867 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:53.414569 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:53.414526 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:53.734742 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:53.734666 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:53.735656 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:53.735639 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8vm6bb" May 27 17:50:56.806546 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.806513 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:50:56.810089 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.810071 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:50:56.813816 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.813787 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 17:50:56.814922 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.814897 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 17:50:56.815051 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.814898 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d6sjf\"" May 27 17:50:56.818392 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.818369 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:50:56.990448 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:56.990408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmm87\" (UniqueName: \"kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87\") pod \"kuadrant-operator-catalog-vs59b\" (UID: \"37930c39-3e98-4d3f-ad85-04c8dbb24f99\") " pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:50:57.091961 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.091859 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmm87\" (UniqueName: \"kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87\") pod \"kuadrant-operator-catalog-vs59b\" (UID: \"37930c39-3e98-4d3f-ad85-04c8dbb24f99\") " pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:50:57.100180 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.100159 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmm87\" (UniqueName: \"kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87\") pod \"kuadrant-operator-catalog-vs59b\" (UID: \"37930c39-3e98-4d3f-ad85-04c8dbb24f99\") " pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:50:57.121717 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.121684 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:50:57.152647 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.152615 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:50:57.258215 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.258185 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:50:57.259521 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:50:57.259494 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37930c39_3e98_4d3f_ad85_04c8dbb24f99.slice/crio-0d64c229cfc95895a3614455add775b40a7b4d96822868c42b9c2556d04945d3 WatchSource:0}: Error finding container 0d64c229cfc95895a3614455add775b40a7b4d96822868c42b9c2556d04945d3: Status 404 returned error can't find the container with id 0d64c229cfc95895a3614455add775b40a7b4d96822868c42b9c2556d04945d3 May 27 17:50:57.361704 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.361672 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4tq9"] May 27 17:50:57.366316 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.366297 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:50:57.373303 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.373274 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4tq9"] May 27 17:50:57.394501 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.394476 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjw5\" (UniqueName: \"kubernetes.io/projected/2bcf6513-2cf6-4c08-8ceb-969cae376a0a-kube-api-access-lmjw5\") pod \"kuadrant-operator-catalog-q4tq9\" (UID: \"2bcf6513-2cf6-4c08-8ceb-969cae376a0a\") " pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:50:57.495241 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.495204 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjw5\" (UniqueName: \"kubernetes.io/projected/2bcf6513-2cf6-4c08-8ceb-969cae376a0a-kube-api-access-lmjw5\") pod \"kuadrant-operator-catalog-q4tq9\" (UID: \"2bcf6513-2cf6-4c08-8ceb-969cae376a0a\") " pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:50:57.504427 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.504394 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjw5\" (UniqueName: \"kubernetes.io/projected/2bcf6513-2cf6-4c08-8ceb-969cae376a0a-kube-api-access-lmjw5\") pod \"kuadrant-operator-catalog-q4tq9\" (UID: \"2bcf6513-2cf6-4c08-8ceb-969cae376a0a\") " pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:50:57.677403 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.677317 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:50:57.751349 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.751313 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" event={"ID":"37930c39-3e98-4d3f-ad85-04c8dbb24f99","Type":"ContainerStarted","Data":"0d64c229cfc95895a3614455add775b40a7b4d96822868c42b9c2556d04945d3"} May 27 17:50:57.817457 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:57.817425 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4tq9"] May 27 17:50:57.830946 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:50:57.830913 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcf6513_2cf6_4c08_8ceb_969cae376a0a.slice/crio-9f2048bbb85ac5823bb6110982836599450ad6ce70ef7405336170e3bf99d888 WatchSource:0}: Error finding container 9f2048bbb85ac5823bb6110982836599450ad6ce70ef7405336170e3bf99d888: Status 404 returned error can't find the container with id 9f2048bbb85ac5823bb6110982836599450ad6ce70ef7405336170e3bf99d888 May 27 17:50:58.757037 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:58.756991 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" event={"ID":"2bcf6513-2cf6-4c08-8ceb-969cae376a0a","Type":"ContainerStarted","Data":"9f2048bbb85ac5823bb6110982836599450ad6ce70ef7405336170e3bf99d888"} May 27 17:50:59.762714 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:59.762673 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" event={"ID":"37930c39-3e98-4d3f-ad85-04c8dbb24f99","Type":"ContainerStarted","Data":"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce"} May 27 17:50:59.763201 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:59.762839 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" podUID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" containerName="registry-server" containerID="cri-o://065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce" gracePeriod=2 May 27 17:50:59.764239 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:59.764213 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" event={"ID":"2bcf6513-2cf6-4c08-8ceb-969cae376a0a","Type":"ContainerStarted","Data":"5430f1ea0b95e878d99f7a5c99416c0b9eb41148989f5489f8cee4a320e7fe90"} May 27 17:50:59.786013 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:59.785958 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" podStartSLOduration=1.459930603 podStartE2EDuration="3.785944143s" podCreationTimestamp="2026-05-27 17:50:56 +0000 UTC" firstStartedPulling="2026-05-27 17:50:57.260802218 +0000 UTC m=+459.697134251" lastFinishedPulling="2026-05-27 17:50:59.586815759 +0000 UTC m=+462.023147791" observedRunningTime="2026-05-27 17:50:59.784246886 +0000 UTC m=+462.220578938" watchObservedRunningTime="2026-05-27 17:50:59.785944143 +0000 UTC m=+462.222276238" May 27 17:50:59.805381 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:50:59.805322 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" podStartSLOduration=1.048036248 podStartE2EDuration="2.805305041s" podCreationTimestamp="2026-05-27 17:50:57 +0000 UTC" firstStartedPulling="2026-05-27 17:50:57.832267355 +0000 UTC m=+460.268599384" lastFinishedPulling="2026-05-27 17:50:59.589536148 +0000 UTC m=+462.025868177" observedRunningTime="2026-05-27 17:50:59.804738428 +0000 UTC m=+462.241070482" watchObservedRunningTime="2026-05-27 17:50:59.805305041 +0000 UTC m=+462.241637122" May 27 17:51:00.098923 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.098900 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:51:00.118540 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.118517 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmm87\" (UniqueName: \"kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87\") pod \"37930c39-3e98-4d3f-ad85-04c8dbb24f99\" (UID: \"37930c39-3e98-4d3f-ad85-04c8dbb24f99\") " May 27 17:51:00.120875 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.120848 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87" (OuterVolumeSpecName: "kube-api-access-mmm87") pod "37930c39-3e98-4d3f-ad85-04c8dbb24f99" (UID: "37930c39-3e98-4d3f-ad85-04c8dbb24f99"). InnerVolumeSpecName "kube-api-access-mmm87". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:00.219402 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.219378 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmm87\" (UniqueName: \"kubernetes.io/projected/37930c39-3e98-4d3f-ad85-04c8dbb24f99-kube-api-access-mmm87\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:00.768988 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.768954 2552 generic.go:358] "Generic (PLEG): container finished" podID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" containerID="065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce" exitCode=0 May 27 17:51:00.769369 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.769015 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" May 27 17:51:00.769369 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.769037 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" event={"ID":"37930c39-3e98-4d3f-ad85-04c8dbb24f99","Type":"ContainerDied","Data":"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce"} May 27 17:51:00.769369 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.769073 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vs59b" event={"ID":"37930c39-3e98-4d3f-ad85-04c8dbb24f99","Type":"ContainerDied","Data":"0d64c229cfc95895a3614455add775b40a7b4d96822868c42b9c2556d04945d3"} May 27 17:51:00.769369 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.769088 2552 scope.go:117] "RemoveContainer" containerID="065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce" May 27 17:51:00.778419 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.778400 2552 scope.go:117] "RemoveContainer" containerID="065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce" May 27 17:51:00.778674 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:51:00.778656 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce\": container with ID starting with 065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce not found: ID does not exist" containerID="065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce" May 27 17:51:00.778726 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.778686 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce"} err="failed to get container status \"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce\": rpc error: code = NotFound desc = could not find container \"065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce\": container with ID starting with 065f22db15f23e7723fb43f69945b1f0708c78c9cd784cc8f1cb2e2a5f7b36ce not found: ID does not exist" May 27 17:51:00.786124 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.786103 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:51:00.790090 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:00.790071 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vs59b"] May 27 17:51:02.211184 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:02.211154 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" path="/var/lib/kubelet/pods/37930c39-3e98-4d3f-ad85-04c8dbb24f99/volumes" May 27 17:51:07.677575 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:07.677520 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:51:07.678001 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:07.677597 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:51:07.698853 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:07.698822 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:51:07.818437 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:07.818411 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-q4tq9" May 27 17:51:09.406127 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.406093 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq"] May 27 17:51:09.406519 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.406416 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" containerName="registry-server" May 27 17:51:09.406519 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.406427 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" containerName="registry-server" May 27 17:51:09.406519 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.406484 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="37930c39-3e98-4d3f-ad85-04c8dbb24f99" containerName="registry-server" May 27 17:51:09.409725 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.409709 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.412359 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.412340 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cjrkq\"" May 27 17:51:09.417852 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.417824 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq"] May 27 17:51:09.499614 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.499546 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rxw6\" (UniqueName: \"kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.499787 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.499673 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.499787 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.499723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.600363 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.600332 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rxw6\" (UniqueName: \"kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.600513 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.600383 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.600513 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.600413 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.600783 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.600766 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.600823 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.600801 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.611209 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.611184 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rxw6\" (UniqueName: \"kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.719530 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.719432 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:09.848228 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:09.848206 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq"] May 27 17:51:09.850211 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:09.850185 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c49494_fb67_49b8_95cb_41d978684640.slice/crio-b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c WatchSource:0}: Error finding container b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c: Status 404 returned error can't find the container with id b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c May 27 17:51:10.201349 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.201311 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk"] May 27 17:51:10.204864 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.204848 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.214800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.214756 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk"] May 27 17:51:10.306182 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.306143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.306362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.306189 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwtxc\" (UniqueName: \"kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.306362 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.306294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.407269 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.407235 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.407651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.407277 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwtxc\" (UniqueName: \"kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.407651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.407338 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.407651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.407618 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.407651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.407642 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.415428 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.415410 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwtxc\" (UniqueName: \"kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.515318 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.515240 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:10.645327 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.645302 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk"] May 27 17:51:10.647644 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:10.647616 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38e9421_be8c_43e9_92f1_97e8a1fda01a.slice/crio-ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed WatchSource:0}: Error finding container ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed: Status 404 returned error can't find the container with id ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed May 27 17:51:10.800524 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.800457 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z"] May 27 17:51:10.803973 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.803958 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:10.811417 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.811050 2552 generic.go:358] "Generic (PLEG): container finished" podID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerID="8165563e4456b589cedad684f69462d9014f3c85d54135c65d83b4ae806fa5b3" exitCode=0 May 27 17:51:10.811417 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.811126 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" event={"ID":"a38e9421-be8c-43e9-92f1-97e8a1fda01a","Type":"ContainerDied","Data":"8165563e4456b589cedad684f69462d9014f3c85d54135c65d83b4ae806fa5b3"} May 27 17:51:10.811417 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.811165 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" event={"ID":"a38e9421-be8c-43e9-92f1-97e8a1fda01a","Type":"ContainerStarted","Data":"ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed"} May 27 17:51:10.812777 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.812756 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z"] May 27 17:51:10.813263 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.813239 2552 generic.go:358] "Generic (PLEG): container finished" podID="f0c49494-fb67-49b8-95cb-41d978684640" containerID="3b32883358e1284dc6f64ade12fee847b80157f16d236541dab0794be3c5cef3" exitCode=0 May 27 17:51:10.813389 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.813302 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" event={"ID":"f0c49494-fb67-49b8-95cb-41d978684640","Type":"ContainerDied","Data":"3b32883358e1284dc6f64ade12fee847b80157f16d236541dab0794be3c5cef3"} May 27 17:51:10.813389 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.813324 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" event={"ID":"f0c49494-fb67-49b8-95cb-41d978684640","Type":"ContainerStarted","Data":"b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c"} May 27 17:51:10.910909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.910872 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:10.910909 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.910918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:10.911114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:10.911079 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7878b\" (UniqueName: \"kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.011794 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.011759 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.011990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.011816 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.011990 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.011897 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7878b\" (UniqueName: \"kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.012170 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.012146 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.012246 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.012175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.020849 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.020823 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7878b\" (UniqueName: \"kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.115765 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.115733 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:11.238382 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.238340 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb"] May 27 17:51:11.243630 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.243610 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.244027 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.244004 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z"] May 27 17:51:11.245968 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:11.245947 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc439b94e_5d8c_40fd_be22_1ac4f99f279d.slice/crio-05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7 WatchSource:0}: Error finding container 05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7: Status 404 returned error can't find the container with id 05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7 May 27 17:51:11.250672 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.250647 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb"] May 27 17:51:11.314994 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.314964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvz7c\" (UniqueName: \"kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.315117 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.315020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.315117 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.315087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.415954 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.415874 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.416405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.415965 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvz7c\" (UniqueName: \"kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.416405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.416017 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.416405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.416241 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.416405 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.416338 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.424793 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.424737 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvz7c\" (UniqueName: \"kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.556062 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.556025 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:11.775634 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.775609 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb"] May 27 17:51:11.778171 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:11.778139 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505eb904_1a17_4e44_87bf_425c00d339ec.slice/crio-be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425 WatchSource:0}: Error finding container be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425: Status 404 returned error can't find the container with id be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425 May 27 17:51:11.819106 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.819080 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" event={"ID":"505eb904-1a17-4e44-87bf-425c00d339ec","Type":"ContainerStarted","Data":"be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425"} May 27 17:51:11.820587 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.820565 2552 generic.go:358] "Generic (PLEG): container finished" podID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerID="32791d6bdc51c6fa6802ddb5a434801180a08c4630268c6d062316d11e3e39c0" exitCode=0 May 27 17:51:11.820689 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.820594 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" event={"ID":"a38e9421-be8c-43e9-92f1-97e8a1fda01a","Type":"ContainerDied","Data":"32791d6bdc51c6fa6802ddb5a434801180a08c4630268c6d062316d11e3e39c0"} May 27 17:51:11.822013 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.821988 2552 generic.go:358] "Generic (PLEG): container finished" podID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerID="829051200d352cae669483c5af1fd28a0a06f1a3988a171d365d263a917e8951" exitCode=0 May 27 17:51:11.822115 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.822014 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" event={"ID":"c439b94e-5d8c-40fd-be22-1ac4f99f279d","Type":"ContainerDied","Data":"829051200d352cae669483c5af1fd28a0a06f1a3988a171d365d263a917e8951"} May 27 17:51:11.822115 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.822035 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" event={"ID":"c439b94e-5d8c-40fd-be22-1ac4f99f279d","Type":"ContainerStarted","Data":"05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7"} May 27 17:51:11.823730 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.823709 2552 generic.go:358] "Generic (PLEG): container finished" podID="f0c49494-fb67-49b8-95cb-41d978684640" containerID="f53f9edde975f014a59fc5d558ca586d6d1bf9d63fe4f159dbeebff38bf85f95" exitCode=0 May 27 17:51:11.823837 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:11.823754 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" event={"ID":"f0c49494-fb67-49b8-95cb-41d978684640","Type":"ContainerDied","Data":"f53f9edde975f014a59fc5d558ca586d6d1bf9d63fe4f159dbeebff38bf85f95"} May 27 17:51:12.829791 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.829758 2552 generic.go:358] "Generic (PLEG): container finished" podID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerID="8940c477d489a95f88cdc3f82a8a8511f0856f71f55768606279d41504a8f214" exitCode=0 May 27 17:51:12.830200 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.829845 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" event={"ID":"c439b94e-5d8c-40fd-be22-1ac4f99f279d","Type":"ContainerDied","Data":"8940c477d489a95f88cdc3f82a8a8511f0856f71f55768606279d41504a8f214"} May 27 17:51:12.831776 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.831753 2552 generic.go:358] "Generic (PLEG): container finished" podID="f0c49494-fb67-49b8-95cb-41d978684640" containerID="95e3e380d50d2ac7b399f7d91f9f1c26851454c35e6209a7a62f04f78eec323d" exitCode=0 May 27 17:51:12.831863 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.831809 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" event={"ID":"f0c49494-fb67-49b8-95cb-41d978684640","Type":"ContainerDied","Data":"95e3e380d50d2ac7b399f7d91f9f1c26851454c35e6209a7a62f04f78eec323d"} May 27 17:51:12.833100 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.833071 2552 generic.go:358] "Generic (PLEG): container finished" podID="505eb904-1a17-4e44-87bf-425c00d339ec" containerID="5273ac3bf7ec31af3bd5c5bdc14ff539bccacf8309b931a9e90e079a425a6af2" exitCode=0 May 27 17:51:12.833180 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.833096 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" event={"ID":"505eb904-1a17-4e44-87bf-425c00d339ec","Type":"ContainerDied","Data":"5273ac3bf7ec31af3bd5c5bdc14ff539bccacf8309b931a9e90e079a425a6af2"} May 27 17:51:12.835141 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.835124 2552 generic.go:358] "Generic (PLEG): container finished" podID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerID="870809ebab079593f60ab82951904ad1d74c0c0dad7775f662da56a23d51bbeb" exitCode=0 May 27 17:51:12.835225 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:12.835204 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" event={"ID":"a38e9421-be8c-43e9-92f1-97e8a1fda01a","Type":"ContainerDied","Data":"870809ebab079593f60ab82951904ad1d74c0c0dad7775f662da56a23d51bbeb"} May 27 17:51:13.841007 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:13.840925 2552 generic.go:358] "Generic (PLEG): container finished" podID="505eb904-1a17-4e44-87bf-425c00d339ec" containerID="2e93dc7c0ef3efe0632e16cd7571880116583c65ec87a95a5f7f5e3e7ba7dbc3" exitCode=0 May 27 17:51:13.841411 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:13.841007 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" event={"ID":"505eb904-1a17-4e44-87bf-425c00d339ec","Type":"ContainerDied","Data":"2e93dc7c0ef3efe0632e16cd7571880116583c65ec87a95a5f7f5e3e7ba7dbc3"} May 27 17:51:13.843065 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:13.843039 2552 generic.go:358] "Generic (PLEG): container finished" podID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerID="0d79a206fc38c86a87cf346b6111d9249a12be99b64e371d3617d0018a583791" exitCode=0 May 27 17:51:13.843168 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:13.843076 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" event={"ID":"c439b94e-5d8c-40fd-be22-1ac4f99f279d","Type":"ContainerDied","Data":"0d79a206fc38c86a87cf346b6111d9249a12be99b64e371d3617d0018a583791"} May 27 17:51:14.048499 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.048476 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:14.051548 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.051528 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:14.138891 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.138857 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util\") pod \"f0c49494-fb67-49b8-95cb-41d978684640\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " May 27 17:51:14.138891 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.138897 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwtxc\" (UniqueName: \"kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc\") pod \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " May 27 17:51:14.139096 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.138926 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rxw6\" (UniqueName: \"kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6\") pod \"f0c49494-fb67-49b8-95cb-41d978684640\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " May 27 17:51:14.139096 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.138949 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle\") pod \"f0c49494-fb67-49b8-95cb-41d978684640\" (UID: \"f0c49494-fb67-49b8-95cb-41d978684640\") " May 27 17:51:14.139096 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.139023 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle\") pod \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " May 27 17:51:14.139259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.139101 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util\") pod \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\" (UID: \"a38e9421-be8c-43e9-92f1-97e8a1fda01a\") " May 27 17:51:14.139630 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.139597 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle" (OuterVolumeSpecName: "bundle") pod "f0c49494-fb67-49b8-95cb-41d978684640" (UID: "f0c49494-fb67-49b8-95cb-41d978684640"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:14.139749 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.139604 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle" (OuterVolumeSpecName: "bundle") pod "a38e9421-be8c-43e9-92f1-97e8a1fda01a" (UID: "a38e9421-be8c-43e9-92f1-97e8a1fda01a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:14.141136 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.141109 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc" (OuterVolumeSpecName: "kube-api-access-vwtxc") pod "a38e9421-be8c-43e9-92f1-97e8a1fda01a" (UID: "a38e9421-be8c-43e9-92f1-97e8a1fda01a"). InnerVolumeSpecName "kube-api-access-vwtxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:14.141361 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.141344 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6" (OuterVolumeSpecName: "kube-api-access-6rxw6") pod "f0c49494-fb67-49b8-95cb-41d978684640" (UID: "f0c49494-fb67-49b8-95cb-41d978684640"). InnerVolumeSpecName "kube-api-access-6rxw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:14.144795 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.144776 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util" (OuterVolumeSpecName: "util") pod "f0c49494-fb67-49b8-95cb-41d978684640" (UID: "f0c49494-fb67-49b8-95cb-41d978684640"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:14.145138 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.145117 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util" (OuterVolumeSpecName: "util") pod "a38e9421-be8c-43e9-92f1-97e8a1fda01a" (UID: "a38e9421-be8c-43e9-92f1-97e8a1fda01a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:14.239950 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.239920 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.239950 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.239947 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.240109 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.239961 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwtxc\" (UniqueName: \"kubernetes.io/projected/a38e9421-be8c-43e9-92f1-97e8a1fda01a-kube-api-access-vwtxc\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.240109 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.239976 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rxw6\" (UniqueName: \"kubernetes.io/projected/f0c49494-fb67-49b8-95cb-41d978684640-kube-api-access-6rxw6\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.240109 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.239991 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0c49494-fb67-49b8-95cb-41d978684640-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.240109 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.240004 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38e9421-be8c-43e9-92f1-97e8a1fda01a-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:14.849037 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.849002 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" May 27 17:51:14.849037 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.849014 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk" event={"ID":"a38e9421-be8c-43e9-92f1-97e8a1fda01a","Type":"ContainerDied","Data":"ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed"} May 27 17:51:14.849037 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.849043 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea95b2869f228b7fac8d286663bcf34ed2b427f49f95a923473bdfea50b3d6ed" May 27 17:51:14.850825 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.850800 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" event={"ID":"f0c49494-fb67-49b8-95cb-41d978684640","Type":"ContainerDied","Data":"b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c"} May 27 17:51:14.850825 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.850813 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq" May 27 17:51:14.850825 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.850826 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b184254349c00fb82f617d6ec92ea4dbf9b2feaeccae683ba550c6994261248c" May 27 17:51:14.852817 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.852786 2552 generic.go:358] "Generic (PLEG): container finished" podID="505eb904-1a17-4e44-87bf-425c00d339ec" containerID="a966ff64ca6119151840c683cf9034e762ad2668c1ff954379c1ef781c918b02" exitCode=0 May 27 17:51:14.852940 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.852869 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" event={"ID":"505eb904-1a17-4e44-87bf-425c00d339ec","Type":"ContainerDied","Data":"a966ff64ca6119151840c683cf9034e762ad2668c1ff954379c1ef781c918b02"} May 27 17:51:14.981258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:14.981238 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:15.047294 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.047261 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle\") pod \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " May 27 17:51:15.047294 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.047298 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7878b\" (UniqueName: \"kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b\") pod \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " May 27 17:51:15.047508 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.047403 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util\") pod \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\" (UID: \"c439b94e-5d8c-40fd-be22-1ac4f99f279d\") " May 27 17:51:15.047889 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.047864 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle" (OuterVolumeSpecName: "bundle") pod "c439b94e-5d8c-40fd-be22-1ac4f99f279d" (UID: "c439b94e-5d8c-40fd-be22-1ac4f99f279d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:15.049425 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.049403 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b" (OuterVolumeSpecName: "kube-api-access-7878b") pod "c439b94e-5d8c-40fd-be22-1ac4f99f279d" (UID: "c439b94e-5d8c-40fd-be22-1ac4f99f279d"). InnerVolumeSpecName "kube-api-access-7878b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:15.052677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.052642 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util" (OuterVolumeSpecName: "util") pod "c439b94e-5d8c-40fd-be22-1ac4f99f279d" (UID: "c439b94e-5d8c-40fd-be22-1ac4f99f279d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:15.148175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.148092 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:15.148175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.148139 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c439b94e-5d8c-40fd-be22-1ac4f99f279d-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:15.148175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.148149 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7878b\" (UniqueName: \"kubernetes.io/projected/c439b94e-5d8c-40fd-be22-1ac4f99f279d-kube-api-access-7878b\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:15.859378 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.859353 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" May 27 17:51:15.859749 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.859342 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z" event={"ID":"c439b94e-5d8c-40fd-be22-1ac4f99f279d","Type":"ContainerDied","Data":"05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7"} May 27 17:51:15.859749 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.859463 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05bb21716d4bfc9c8fc4b29827d1f0d4859d457c139d40dad55039c53b11c4b7" May 27 17:51:15.980925 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:15.980900 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:16.056044 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.056013 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvz7c\" (UniqueName: \"kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c\") pod \"505eb904-1a17-4e44-87bf-425c00d339ec\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " May 27 17:51:16.056203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.056115 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle\") pod \"505eb904-1a17-4e44-87bf-425c00d339ec\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " May 27 17:51:16.056203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.056143 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util\") pod \"505eb904-1a17-4e44-87bf-425c00d339ec\" (UID: \"505eb904-1a17-4e44-87bf-425c00d339ec\") " May 27 17:51:16.056617 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.056584 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle" (OuterVolumeSpecName: "bundle") pod "505eb904-1a17-4e44-87bf-425c00d339ec" (UID: "505eb904-1a17-4e44-87bf-425c00d339ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:16.058084 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.058059 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c" (OuterVolumeSpecName: "kube-api-access-tvz7c") pod "505eb904-1a17-4e44-87bf-425c00d339ec" (UID: "505eb904-1a17-4e44-87bf-425c00d339ec"). InnerVolumeSpecName "kube-api-access-tvz7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:16.061548 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.061528 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util" (OuterVolumeSpecName: "util") pod "505eb904-1a17-4e44-87bf-425c00d339ec" (UID: "505eb904-1a17-4e44-87bf-425c00d339ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:16.157724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.157647 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:16.157724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.157672 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/505eb904-1a17-4e44-87bf-425c00d339ec-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:16.157724 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.157682 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvz7c\" (UniqueName: \"kubernetes.io/projected/505eb904-1a17-4e44-87bf-425c00d339ec-kube-api-access-tvz7c\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:51:16.865231 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.865195 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" event={"ID":"505eb904-1a17-4e44-87bf-425c00d339ec","Type":"ContainerDied","Data":"be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425"} May 27 17:51:16.865231 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.865228 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be18b988599fec179a751d5cf07bcd2fb66afe0f2ad904daf5f4fca8c9675425" May 27 17:51:16.865787 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:16.865253 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb" May 27 17:51:26.727147 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727111 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8rnzv"] May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727442 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727453 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727466 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727472 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727478 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727484 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727490 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727496 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727504 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727509 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727515 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727520 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727526 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727531 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727541 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727547 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="extract" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727567 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727572 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727579 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727584 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727590 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727594 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="util" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727600 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727604 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="pull" May 27 17:51:26.727651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727656 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c439b94e-5d8c-40fd-be22-1ac4f99f279d" containerName="extract" May 27 17:51:26.728366 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727665 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a38e9421-be8c-43e9-92f1-97e8a1fda01a" containerName="extract" May 27 17:51:26.728366 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727672 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0c49494-fb67-49b8-95cb-41d978684640" containerName="extract" May 27 17:51:26.728366 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.727679 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="505eb904-1a17-4e44-87bf-425c00d339ec" containerName="extract" May 27 17:51:26.736330 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.736308 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:26.741128 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.741104 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-46pwr\"" May 27 17:51:26.754258 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.754233 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8rnzv"] May 27 17:51:26.847106 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.847063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkch\" (UniqueName: \"kubernetes.io/projected/d87784bf-5ce9-4178-8f01-82ddd2197974-kube-api-access-jtkch\") pod \"authorino-operator-657f44b778-8rnzv\" (UID: \"d87784bf-5ce9-4178-8f01-82ddd2197974\") " pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:26.948352 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.948313 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkch\" (UniqueName: \"kubernetes.io/projected/d87784bf-5ce9-4178-8f01-82ddd2197974-kube-api-access-jtkch\") pod \"authorino-operator-657f44b778-8rnzv\" (UID: \"d87784bf-5ce9-4178-8f01-82ddd2197974\") " pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:26.961027 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:26.960999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkch\" (UniqueName: \"kubernetes.io/projected/d87784bf-5ce9-4178-8f01-82ddd2197974-kube-api-access-jtkch\") pod \"authorino-operator-657f44b778-8rnzv\" (UID: \"d87784bf-5ce9-4178-8f01-82ddd2197974\") " pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:27.045652 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:27.045540 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:27.178613 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:27.178584 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8rnzv"] May 27 17:51:27.180699 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:27.180669 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87784bf_5ce9_4178_8f01_82ddd2197974.slice/crio-12572ac57da41f4b8c1cfd467c222282f5ecce1d10122f4bb9abd4880d125ba1 WatchSource:0}: Error finding container 12572ac57da41f4b8c1cfd467c222282f5ecce1d10122f4bb9abd4880d125ba1: Status 404 returned error can't find the container with id 12572ac57da41f4b8c1cfd467c222282f5ecce1d10122f4bb9abd4880d125ba1 May 27 17:51:27.910395 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:27.910352 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" event={"ID":"d87784bf-5ce9-4178-8f01-82ddd2197974","Type":"ContainerStarted","Data":"12572ac57da41f4b8c1cfd467c222282f5ecce1d10122f4bb9abd4880d125ba1"} May 27 17:51:29.921506 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:29.921465 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" event={"ID":"d87784bf-5ce9-4178-8f01-82ddd2197974","Type":"ContainerStarted","Data":"88cf783ee1ad520b5f37d39df540577f5e038d5b1cc0d2f31de33fcd9ab9fe8a"} May 27 17:51:29.921900 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:29.921516 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:29.942960 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:29.942915 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" podStartSLOduration=1.66025939 podStartE2EDuration="3.942901444s" podCreationTimestamp="2026-05-27 17:51:26 +0000 UTC" firstStartedPulling="2026-05-27 17:51:27.182502708 +0000 UTC m=+489.618834737" lastFinishedPulling="2026-05-27 17:51:29.465144761 +0000 UTC m=+491.901476791" observedRunningTime="2026-05-27 17:51:29.939891636 +0000 UTC m=+492.376223687" watchObservedRunningTime="2026-05-27 17:51:29.942901444 +0000 UTC m=+492.379233496" May 27 17:51:40.927131 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:40.927102 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-8rnzv" May 27 17:51:47.453064 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.453024 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw"] May 27 17:51:47.458748 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.458715 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.461507 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.461460 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 27 17:51:47.462639 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.462616 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cjrkq\"" May 27 17:51:47.462989 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.462664 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 27 17:51:47.465677 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.465653 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw"] May 27 17:51:47.517123 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.517086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zct5\" (UniqueName: \"kubernetes.io/projected/57164937-4c14-4942-8863-5dc8794c749a-kube-api-access-7zct5\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.517316 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.517173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57164937-4c14-4942-8863-5dc8794c749a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.517316 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.517240 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/57164937-4c14-4942-8863-5dc8794c749a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.617791 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.617753 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/57164937-4c14-4942-8863-5dc8794c749a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.617980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.617850 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zct5\" (UniqueName: \"kubernetes.io/projected/57164937-4c14-4942-8863-5dc8794c749a-kube-api-access-7zct5\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.617980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.617886 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57164937-4c14-4942-8863-5dc8794c749a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.618487 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.618462 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57164937-4c14-4942-8863-5dc8794c749a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.620212 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.620192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/57164937-4c14-4942-8863-5dc8794c749a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.626944 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.626919 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zct5\" (UniqueName: \"kubernetes.io/projected/57164937-4c14-4942-8863-5dc8794c749a-kube-api-access-7zct5\") pod \"kuadrant-console-plugin-6cb54b5c86-trvrw\" (UID: \"57164937-4c14-4942-8863-5dc8794c749a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.770025 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.769933 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" May 27 17:51:47.906180 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.906151 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw"] May 27 17:51:47.907926 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:51:47.907895 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57164937_4c14_4942_8863_5dc8794c749a.slice/crio-c2bb06e2cf5122b866fcd0711cbab5db988e9d349e39b4c340d45a8ed957ef35 WatchSource:0}: Error finding container c2bb06e2cf5122b866fcd0711cbab5db988e9d349e39b4c340d45a8ed957ef35: Status 404 returned error can't find the container with id c2bb06e2cf5122b866fcd0711cbab5db988e9d349e39b4c340d45a8ed957ef35 May 27 17:51:47.988548 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:47.988511 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" event={"ID":"57164937-4c14-4942-8863-5dc8794c749a","Type":"ContainerStarted","Data":"c2bb06e2cf5122b866fcd0711cbab5db988e9d349e39b4c340d45a8ed957ef35"} May 27 17:51:56.876406 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.876368 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp"] May 27 17:51:56.883129 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.883104 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:56.889732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.889690 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h2nww\"" May 27 17:51:56.889732 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.889719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:56.889955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.889886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsq6d\" (UniqueName: \"kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:56.902080 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.902054 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp"] May 27 17:51:56.990982 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.990944 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsq6d\" (UniqueName: \"kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:56.991194 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.991021 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:56.991464 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:56.991441 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:57.008128 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.008102 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsq6d\" (UniqueName: \"kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:57.202680 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.202596 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:51:57.631031 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.630993 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp"] May 27 17:51:57.639042 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.638745 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp"] May 27 17:51:57.660061 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.660021 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:51:57.668014 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.667987 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.683530 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.683173 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:51:57.696251 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.696218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.696416 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.696340 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sw4g\" (UniqueName: \"kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.797617 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.797566 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.797810 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.797677 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sw4g\" (UniqueName: \"kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.798113 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.798073 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.809406 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.809378 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sw4g\" (UniqueName: \"kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:51:57.984600 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:51:57.984490 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:52:11.028803 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:11.028775 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:52:11.045607 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:52:11.045582 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38280a95_30fc_450d_957b_c30c67a7c2ec.slice/crio-b4aa77ef82c117365132e4f5c677d716cb06364982581827e561d22c0eef1884 WatchSource:0}: Error finding container b4aa77ef82c117365132e4f5c677d716cb06364982581827e561d22c0eef1884: Status 404 returned error can't find the container with id b4aa77ef82c117365132e4f5c677d716cb06364982581827e561d22c0eef1884 May 27 17:52:11.091396 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:11.091363 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" event={"ID":"38280a95-30fc-450d-957b-c30c67a7c2ec","Type":"ContainerStarted","Data":"b4aa77ef82c117365132e4f5c677d716cb06364982581827e561d22c0eef1884"} May 27 17:52:11.092661 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:11.092637 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" event={"ID":"57164937-4c14-4942-8863-5dc8794c749a","Type":"ContainerStarted","Data":"c253f91f4d68844100b7619757fde4cf6baeca495abb7651c92ba17d3dade7fc"} May 27 17:52:11.114360 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:11.114311 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-trvrw" podStartSLOduration=1.05196697 podStartE2EDuration="24.114297115s" podCreationTimestamp="2026-05-27 17:51:47 +0000 UTC" firstStartedPulling="2026-05-27 17:51:47.90970347 +0000 UTC m=+510.346035500" lastFinishedPulling="2026-05-27 17:52:10.9720336 +0000 UTC m=+533.408365645" observedRunningTime="2026-05-27 17:52:11.111891399 +0000 UTC m=+533.548223451" watchObservedRunningTime="2026-05-27 17:52:11.114297115 +0000 UTC m=+533.550629167" May 27 17:52:13.413413 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:52:13.413374 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6b91df_a8df_49f5_990c_2b3f1a73fb10.slice/crio-193e45b487d34ff74598409311526b285cbc1bb972f15f61e58436a60ebf0445 WatchSource:0}: Error finding container 193e45b487d34ff74598409311526b285cbc1bb972f15f61e58436a60ebf0445: Status 404 returned error can't find the container with id 193e45b487d34ff74598409311526b285cbc1bb972f15f61e58436a60ebf0445 May 27 17:52:17.120756 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.120723 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" event={"ID":"38280a95-30fc-450d-957b-c30c67a7c2ec","Type":"ContainerStarted","Data":"6295a83005df39d84de08460c57c795d616418510b5312309c184d12be0ea258"} May 27 17:52:17.121259 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.120801 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:52:17.122308 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.122278 2552 generic.go:358] "Generic (PLEG): container finished" podID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" containerID="9bdf1ea454207de8d39e2a3c9cb0a9117199ec457665d878a1dbdee0e594c06f" exitCode=1 May 27 17:52:17.153280 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.153258 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:52:17.163117 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.163087 2552 status_manager.go:895] "Failed to get status for pod" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" May 27 17:52:17.282780 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.282747 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume\") pod \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " May 27 17:52:17.282780 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.282784 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsq6d\" (UniqueName: \"kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d\") pod \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\" (UID: \"3e6b91df-a8df-49f5-990c-2b3f1a73fb10\") " May 27 17:52:17.283068 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.283048 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e6b91df-a8df-49f5-990c-2b3f1a73fb10" (UID: "3e6b91df-a8df-49f5-990c-2b3f1a73fb10"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:52:17.284857 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.284833 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d" (OuterVolumeSpecName: "kube-api-access-zsq6d") pod "3e6b91df-a8df-49f5-990c-2b3f1a73fb10" (UID: "3e6b91df-a8df-49f5-990c-2b3f1a73fb10"). InnerVolumeSpecName "kube-api-access-zsq6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:52:17.383793 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.383713 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-extensions-socket-volume\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:52:17.383793 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:17.383739 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsq6d\" (UniqueName: \"kubernetes.io/projected/3e6b91df-a8df-49f5-990c-2b3f1a73fb10-kube-api-access-zsq6d\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:52:18.126210 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.126179 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" May 27 17:52:18.126696 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.126243 2552 scope.go:117] "RemoveContainer" containerID="9bdf1ea454207de8d39e2a3c9cb0a9117199ec457665d878a1dbdee0e594c06f" May 27 17:52:18.129743 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.129697 2552 status_manager.go:895] "Failed to get status for pod" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" May 27 17:52:18.136928 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.136898 2552 status_manager.go:895] "Failed to get status for pod" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" May 27 17:52:18.211074 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.211046 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" path="/var/lib/kubelet/pods/3e6b91df-a8df-49f5-990c-2b3f1a73fb10/volumes" May 27 17:52:18.212764 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:18.212713 2552 status_manager.go:895] "Failed to get status for pod" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-bfpcp\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" May 27 17:52:28.128518 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:28.128485 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:52:28.149816 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:28.149639 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" podStartSLOduration=26.072920583 podStartE2EDuration="31.149622571s" podCreationTimestamp="2026-05-27 17:51:57 +0000 UTC" firstStartedPulling="2026-05-27 17:52:11.048023565 +0000 UTC m=+533.484355595" lastFinishedPulling="2026-05-27 17:52:16.124725534 +0000 UTC m=+538.561057583" observedRunningTime="2026-05-27 17:52:17.160684809 +0000 UTC m=+539.597016862" watchObservedRunningTime="2026-05-27 17:52:28.149622571 +0000 UTC m=+550.585954625" May 27 17:52:40.003073 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.003035 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:52:40.003667 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.003361 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" podUID="38280a95-30fc-450d-957b-c30c67a7c2ec" containerName="manager" containerID="cri-o://6295a83005df39d84de08460c57c795d616418510b5312309c184d12be0ea258" gracePeriod=10 May 27 17:52:40.216255 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.216223 2552 generic.go:358] "Generic (PLEG): container finished" podID="38280a95-30fc-450d-957b-c30c67a7c2ec" containerID="6295a83005df39d84de08460c57c795d616418510b5312309c184d12be0ea258" exitCode=0 May 27 17:52:40.216423 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.216295 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" event={"ID":"38280a95-30fc-450d-957b-c30c67a7c2ec","Type":"ContainerDied","Data":"6295a83005df39d84de08460c57c795d616418510b5312309c184d12be0ea258"} May 27 17:52:40.307604 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.307581 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:52:40.495188 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.495145 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sw4g\" (UniqueName: \"kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g\") pod \"38280a95-30fc-450d-957b-c30c67a7c2ec\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " May 27 17:52:40.495374 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.495243 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume\") pod \"38280a95-30fc-450d-957b-c30c67a7c2ec\" (UID: \"38280a95-30fc-450d-957b-c30c67a7c2ec\") " May 27 17:52:40.495621 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.495589 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "38280a95-30fc-450d-957b-c30c67a7c2ec" (UID: "38280a95-30fc-450d-957b-c30c67a7c2ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:52:40.497446 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.497417 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g" (OuterVolumeSpecName: "kube-api-access-8sw4g") pod "38280a95-30fc-450d-957b-c30c67a7c2ec" (UID: "38280a95-30fc-450d-957b-c30c67a7c2ec"). InnerVolumeSpecName "kube-api-access-8sw4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:52:40.596216 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.596182 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38280a95-30fc-450d-957b-c30c67a7c2ec-extensions-socket-volume\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:52:40.596216 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:40.596214 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sw4g\" (UniqueName: \"kubernetes.io/projected/38280a95-30fc-450d-957b-c30c67a7c2ec-kube-api-access-8sw4g\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:52:41.221644 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:41.221615 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" May 27 17:52:41.221644 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:41.221628 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk" event={"ID":"38280a95-30fc-450d-957b-c30c67a7c2ec","Type":"ContainerDied","Data":"b4aa77ef82c117365132e4f5c677d716cb06364982581827e561d22c0eef1884"} May 27 17:52:41.222114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:41.221672 2552 scope.go:117] "RemoveContainer" containerID="6295a83005df39d84de08460c57c795d616418510b5312309c184d12be0ea258" May 27 17:52:41.244879 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:41.244845 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:52:41.249122 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:41.249100 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hf7wk"] May 27 17:52:42.211039 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:42.211006 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38280a95-30fc-450d-957b-c30c67a7c2ec" path="/var/lib/kubelet/pods/38280a95-30fc-450d-957b-c30c67a7c2ec/volumes" May 27 17:52:44.428639 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.428593 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9"] May 27 17:52:44.429139 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429112 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38280a95-30fc-450d-957b-c30c67a7c2ec" containerName="manager" May 27 17:52:44.429139 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429138 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="38280a95-30fc-450d-957b-c30c67a7c2ec" containerName="manager" May 27 17:52:44.429257 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429158 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" containerName="manager" May 27 17:52:44.429257 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429166 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" containerName="manager" May 27 17:52:44.429361 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429296 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e6b91df-a8df-49f5-990c-2b3f1a73fb10" containerName="manager" May 27 17:52:44.429361 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.429318 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="38280a95-30fc-450d-957b-c30c67a7c2ec" containerName="manager" May 27 17:52:44.440800 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.440776 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.443878 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.443674 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gkhdd\"" May 27 17:52:44.445709 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.445659 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9"] May 27 17:52:44.630874 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.630837 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631049 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.630898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631049 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.630970 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631049 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631049 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631194 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631194 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090a3d-cb29-43a4-b283-45193a62e50a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631194 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.631194 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.631157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsf2q\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-kube-api-access-bsf2q\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732238 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732152 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732238 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732194 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsf2q\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-kube-api-access-bsf2q\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732440 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732245 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732440 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732307 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732440 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732344 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732440 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732370 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732655 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732438 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732655 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732494 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732655 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732523 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090a3d-cb29-43a4-b283-45193a62e50a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732852 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732949 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732867 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.732949 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.732905 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.733120 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.733099 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.733189 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.733173 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090a3d-cb29-43a4-b283-45193a62e50a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.734607 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.734584 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.734747 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.734728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.740898 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.740878 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.741058 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.741039 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsf2q\" (UniqueName: \"kubernetes.io/projected/f1090a3d-cb29-43a4-b283-45193a62e50a-kube-api-access-bsf2q\") pod \"maas-default-gateway-openshift-default-7df95f575-ffdm9\" (UID: \"f1090a3d-cb29-43a4-b283-45193a62e50a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.753895 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.753876 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:44.887485 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.887453 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9"] May 27 17:52:44.888535 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:52:44.888504 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1090a3d_cb29_43a4_b283_45193a62e50a.slice/crio-0af1c1c9692d840c97e7ea7f2c32eaa03750ccaddfc314c9a7f3c8c6c3f65b4d WatchSource:0}: Error finding container 0af1c1c9692d840c97e7ea7f2c32eaa03750ccaddfc314c9a7f3c8c6c3f65b4d: Status 404 returned error can't find the container with id 0af1c1c9692d840c97e7ea7f2c32eaa03750ccaddfc314c9a7f3c8c6c3f65b4d May 27 17:52:44.890712 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.890680 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:52:44.890804 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.890748 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:52:44.890804 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:44.890775 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} May 27 17:52:45.240290 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:45.240253 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" event={"ID":"f1090a3d-cb29-43a4-b283-45193a62e50a","Type":"ContainerStarted","Data":"67333014b4818007def59f113361fb5aad945ac2bde95c0f0c3cfb7b7fd86522"} May 27 17:52:45.240538 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:45.240297 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" event={"ID":"f1090a3d-cb29-43a4-b283-45193a62e50a","Type":"ContainerStarted","Data":"0af1c1c9692d840c97e7ea7f2c32eaa03750ccaddfc314c9a7f3c8c6c3f65b4d"} May 27 17:52:45.260384 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:45.260334 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" podStartSLOduration=1.260319063 podStartE2EDuration="1.260319063s" podCreationTimestamp="2026-05-27 17:52:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:52:45.259846707 +0000 UTC m=+567.696178772" watchObservedRunningTime="2026-05-27 17:52:45.260319063 +0000 UTC m=+567.696651115" May 27 17:52:45.754573 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:45.754518 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:45.759233 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:45.759207 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:46.244638 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:46.244610 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:46.245686 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:46.245662 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ffdm9" May 27 17:52:49.092920 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.092891 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:52:49.095386 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.095369 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.098082 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.098062 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 17:52:49.104377 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.104352 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:52:49.133400 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.133361 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:52:49.171133 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.171102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/582e6685-e4c3-4b04-8ed4-5ad86e73558e-config-file\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.171264 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.171149 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvf4f\" (UniqueName: \"kubernetes.io/projected/582e6685-e4c3-4b04-8ed4-5ad86e73558e-kube-api-access-fvf4f\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.272538 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.272504 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/582e6685-e4c3-4b04-8ed4-5ad86e73558e-config-file\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.272722 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.272576 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvf4f\" (UniqueName: \"kubernetes.io/projected/582e6685-e4c3-4b04-8ed4-5ad86e73558e-kube-api-access-fvf4f\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.273092 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.273072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/582e6685-e4c3-4b04-8ed4-5ad86e73558e-config-file\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.280375 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.280347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvf4f\" (UniqueName: \"kubernetes.io/projected/582e6685-e4c3-4b04-8ed4-5ad86e73558e-kube-api-access-fvf4f\") pod \"limitador-limitador-78c99df468-5xs4m\" (UID: \"582e6685-e4c3-4b04-8ed4-5ad86e73558e\") " pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.407314 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.407279 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:49.543134 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:49.543103 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:52:49.545000 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:52:49.544974 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582e6685_e4c3_4b04_8ed4_5ad86e73558e.slice/crio-bfaf38768ab1185db7b86132f9b5c6b51fa36b83a155b7952dfccb5fa1e77acb WatchSource:0}: Error finding container bfaf38768ab1185db7b86132f9b5c6b51fa36b83a155b7952dfccb5fa1e77acb: Status 404 returned error can't find the container with id bfaf38768ab1185db7b86132f9b5c6b51fa36b83a155b7952dfccb5fa1e77acb May 27 17:52:50.264019 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:50.263982 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" event={"ID":"582e6685-e4c3-4b04-8ed4-5ad86e73558e","Type":"ContainerStarted","Data":"bfaf38768ab1185db7b86132f9b5c6b51fa36b83a155b7952dfccb5fa1e77acb"} May 27 17:52:52.278590 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:52.278463 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" event={"ID":"582e6685-e4c3-4b04-8ed4-5ad86e73558e","Type":"ContainerStarted","Data":"e9b501cf3a7b94cad42b5d2369b79e3662e77cf4c90a04951bf638f7ea2e5881"} May 27 17:52:52.278955 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:52.278592 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:52:52.298675 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:52:52.298628 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" podStartSLOduration=0.872382332 podStartE2EDuration="3.298614768s" podCreationTimestamp="2026-05-27 17:52:49 +0000 UTC" firstStartedPulling="2026-05-27 17:52:49.546774254 +0000 UTC m=+571.983106284" lastFinishedPulling="2026-05-27 17:52:51.973006677 +0000 UTC m=+574.409338720" observedRunningTime="2026-05-27 17:52:52.295462594 +0000 UTC m=+574.731794648" watchObservedRunningTime="2026-05-27 17:52:52.298614768 +0000 UTC m=+574.734946820" May 27 17:53:03.283430 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:53:03.283397 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5xs4m" May 27 17:53:56.357456 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:53:56.357420 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:54:19.490971 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:19.490939 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:54:22.705266 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:22.705230 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:54:34.068582 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.068531 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt"] May 27 17:54:34.072412 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.072389 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.076270 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.076244 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 17:54:34.076383 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.076247 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 17:54:34.076383 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.076251 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 17:54:34.076383 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.076253 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8lks5\"" May 27 17:54:34.082687 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.082660 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt"] May 27 17:54:34.196997 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.196962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3715dc2-acc2-4187-9284-4311459578c3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.197211 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.197076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2lz\" (UniqueName: \"kubernetes.io/projected/c3715dc2-acc2-4187-9284-4311459578c3-kube-api-access-rs2lz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.197211 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.197107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.197211 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.197146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.197211 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.197169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.197345 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.197218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298596 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298542 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3715dc2-acc2-4187-9284-4311459578c3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298762 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298657 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2lz\" (UniqueName: \"kubernetes.io/projected/c3715dc2-acc2-4187-9284-4311459578c3-kube-api-access-rs2lz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298762 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298686 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298854 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298830 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298907 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298881 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.298960 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.298918 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.299141 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.299122 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.299295 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.299277 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.299380 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.299360 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.301013 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.300987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3715dc2-acc2-4187-9284-4311459578c3-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.301108 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.301089 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3715dc2-acc2-4187-9284-4311459578c3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.307989 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.307964 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs2lz\" (UniqueName: \"kubernetes.io/projected/c3715dc2-acc2-4187-9284-4311459578c3-kube-api-access-rs2lz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-7r9gt\" (UID: \"c3715dc2-acc2-4187-9284-4311459578c3\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.387314 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.387279 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:34.529447 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.529419 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt"] May 27 17:54:34.531326 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:54:34.531300 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3715dc2_acc2_4187_9284_4311459578c3.slice/crio-4a6cf6fe8810587bc1604b4f84ff83218b1e7132d4e49b7006871056f367e90b WatchSource:0}: Error finding container 4a6cf6fe8810587bc1604b4f84ff83218b1e7132d4e49b7006871056f367e90b: Status 404 returned error can't find the container with id 4a6cf6fe8810587bc1604b4f84ff83218b1e7132d4e49b7006871056f367e90b May 27 17:54:34.532957 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.532942 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:54:34.665112 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.665027 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" event={"ID":"c3715dc2-acc2-4187-9284-4311459578c3","Type":"ContainerStarted","Data":"4a6cf6fe8810587bc1604b4f84ff83218b1e7132d4e49b7006871056f367e90b"} May 27 17:54:34.892139 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:34.892100 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:54:40.694189 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:40.694152 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" event={"ID":"c3715dc2-acc2-4187-9284-4311459578c3","Type":"ContainerStarted","Data":"7af29e67683a95b1d06da0dbb282ae39626f90ee9539f9750033e749c8b482c9"} May 27 17:54:42.613371 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:42.613335 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:54:45.714704 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:45.714673 2552 generic.go:358] "Generic (PLEG): container finished" podID="c3715dc2-acc2-4187-9284-4311459578c3" containerID="7af29e67683a95b1d06da0dbb282ae39626f90ee9539f9750033e749c8b482c9" exitCode=0 May 27 17:54:45.715195 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:45.714745 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" event={"ID":"c3715dc2-acc2-4187-9284-4311459578c3","Type":"ContainerDied","Data":"7af29e67683a95b1d06da0dbb282ae39626f90ee9539f9750033e749c8b482c9"} May 27 17:54:47.723711 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:47.723675 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" event={"ID":"c3715dc2-acc2-4187-9284-4311459578c3","Type":"ContainerStarted","Data":"60b67159a84d07e759901cffd917a862f8bda56d366ad88b66a76e2d0a39337e"} May 27 17:54:47.724093 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:47.723893 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:54:47.750443 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:47.750367 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" podStartSLOduration=1.481010606 podStartE2EDuration="13.75034728s" podCreationTimestamp="2026-05-27 17:54:34 +0000 UTC" firstStartedPulling="2026-05-27 17:54:34.533070857 +0000 UTC m=+676.969402886" lastFinishedPulling="2026-05-27 17:54:46.802407527 +0000 UTC m=+689.238739560" observedRunningTime="2026-05-27 17:54:47.749032383 +0000 UTC m=+690.185364456" watchObservedRunningTime="2026-05-27 17:54:47.75034728 +0000 UTC m=+690.186679333" May 27 17:54:58.741729 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:54:58.741692 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-7r9gt" May 27 17:55:07.595201 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:55:07.595115 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:55:42.096114 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:55:42.096075 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:56:28.595840 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:28.595801 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:56:39.292917 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:39.292831 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:56:48.529411 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:48.529371 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:56:55.396333 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.396291 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-bbc979b75-dxmmf"] May 27 17:56:55.400175 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.400147 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.412825 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.412803 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbc979b75-dxmmf"] May 27 17:56:55.427673 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427649 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-oauth-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.427835 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427683 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-trusted-ca-bundle\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.427835 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427704 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ncnb\" (UniqueName: \"kubernetes.io/projected/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-kube-api-access-6ncnb\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.427835 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427773 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-oauth-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.427835 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.428095 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-service-ca\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.428095 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.427960 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.528642 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528596 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-service-ca\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.528642 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528648 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.528907 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528686 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-oauth-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.528907 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528716 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-trusted-ca-bundle\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.528907 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528737 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ncnb\" (UniqueName: \"kubernetes.io/projected/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-kube-api-access-6ncnb\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529077 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528937 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-oauth-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529077 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.528977 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529459 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.529429 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-service-ca\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529651 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.529630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-oauth-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529752 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.529731 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.529818 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.529780 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-trusted-ca-bundle\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.531193 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.531169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-serving-cert\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.531263 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.531247 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-console-oauth-config\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.542577 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.542543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ncnb\" (UniqueName: \"kubernetes.io/projected/2d9810e3-27ea-4432-8bf2-a3e392b2abfa-kube-api-access-6ncnb\") pod \"console-bbc979b75-dxmmf\" (UID: \"2d9810e3-27ea-4432-8bf2-a3e392b2abfa\") " pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.709376 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.709344 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:56:55.849597 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:55.849542 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbc979b75-dxmmf"] May 27 17:56:55.851128 ip-10-0-129-78 kubenswrapper[2552]: W0527 17:56:55.851098 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9810e3_27ea_4432_8bf2_a3e392b2abfa.slice/crio-f7f94e202be7f615ac8bd6cd56d9f643c9b989d5488937c4479024788fbb92e7 WatchSource:0}: Error finding container f7f94e202be7f615ac8bd6cd56d9f643c9b989d5488937c4479024788fbb92e7: Status 404 returned error can't find the container with id f7f94e202be7f615ac8bd6cd56d9f643c9b989d5488937c4479024788fbb92e7 May 27 17:56:56.221374 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:56.221330 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbc979b75-dxmmf" event={"ID":"2d9810e3-27ea-4432-8bf2-a3e392b2abfa","Type":"ContainerStarted","Data":"31a3d2412f63c5a733a320f43abdb5e11cf359706772a1ec7984a9bc08af8690"} May 27 17:56:56.221374 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:56.221374 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbc979b75-dxmmf" event={"ID":"2d9810e3-27ea-4432-8bf2-a3e392b2abfa","Type":"ContainerStarted","Data":"f7f94e202be7f615ac8bd6cd56d9f643c9b989d5488937c4479024788fbb92e7"} May 27 17:56:56.250624 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:56.250570 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-bbc979b75-dxmmf" podStartSLOduration=1.250537722 podStartE2EDuration="1.250537722s" podCreationTimestamp="2026-05-27 17:56:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:56:56.249191753 +0000 UTC m=+818.685523801" watchObservedRunningTime="2026-05-27 17:56:56.250537722 +0000 UTC m=+818.686869774" May 27 17:56:59.497980 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:56:59.497938 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:57:05.710117 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:05.710083 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:57:05.710117 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:05.710125 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:57:05.715190 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:05.715167 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:57:06.267726 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:06.267697 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bbc979b75-dxmmf" May 27 17:57:06.337859 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:06.337818 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:57:07.494230 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:07.494190 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:57:18.312373 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:18.312334 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:57:31.361220 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.361159 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-745f556cd7-tskps" podUID="a46a94dc-a8c3-468e-9d3e-cba781462c30" containerName="console" containerID="cri-o://006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c" gracePeriod=15 May 27 17:57:31.613470 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.613410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-745f556cd7-tskps_a46a94dc-a8c3-468e-9d3e-cba781462c30/console/0.log" May 27 17:57:31.613608 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.613475 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f556cd7-tskps" May 27 17:57:31.667030 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667003 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667037 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667067 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667086 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667129 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667203 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667144 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667466 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667207 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5k7h\" (UniqueName: \"kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h\") pod \"a46a94dc-a8c3-468e-9d3e-cba781462c30\" (UID: \"a46a94dc-a8c3-468e-9d3e-cba781462c30\") " May 27 17:57:31.667526 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667503 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca" (OuterVolumeSpecName: "service-ca") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:57:31.667666 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667637 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:57:31.667757 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667733 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config" (OuterVolumeSpecName: "console-config") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:57:31.667866 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.667844 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:57:31.669424 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.669394 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:57:31.669527 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.669433 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:57:31.669527 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.669498 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h" (OuterVolumeSpecName: "kube-api-access-p5k7h") pod "a46a94dc-a8c3-468e-9d3e-cba781462c30" (UID: "a46a94dc-a8c3-468e-9d3e-cba781462c30"). InnerVolumeSpecName "kube-api-access-p5k7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:57:31.768357 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768324 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768357 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768359 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768375 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768385 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46a94dc-a8c3-468e-9d3e-cba781462c30-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768393 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5k7h\" (UniqueName: \"kubernetes.io/projected/a46a94dc-a8c3-468e-9d3e-cba781462c30-kube-api-access-p5k7h\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768404 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:31.768576 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:31.768412 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46a94dc-a8c3-468e-9d3e-cba781462c30-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 17:57:32.367674 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367646 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-745f556cd7-tskps_a46a94dc-a8c3-468e-9d3e-cba781462c30/console/0.log" May 27 17:57:32.368142 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367692 2552 generic.go:358] "Generic (PLEG): container finished" podID="a46a94dc-a8c3-468e-9d3e-cba781462c30" containerID="006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c" exitCode=2 May 27 17:57:32.368142 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367758 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f556cd7-tskps" May 27 17:57:32.368142 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367762 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f556cd7-tskps" event={"ID":"a46a94dc-a8c3-468e-9d3e-cba781462c30","Type":"ContainerDied","Data":"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c"} May 27 17:57:32.368142 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367799 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f556cd7-tskps" event={"ID":"a46a94dc-a8c3-468e-9d3e-cba781462c30","Type":"ContainerDied","Data":"801dfeefb98fe7968aeb60b6798b1aee0855d88ac12d6e4c7460f32e4d4d0068"} May 27 17:57:32.368142 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.367823 2552 scope.go:117] "RemoveContainer" containerID="006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c" May 27 17:57:32.376523 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.376501 2552 scope.go:117] "RemoveContainer" containerID="006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c" May 27 17:57:32.376820 ip-10-0-129-78 kubenswrapper[2552]: E0527 17:57:32.376799 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c\": container with ID starting with 006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c not found: ID does not exist" containerID="006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c" May 27 17:57:32.376894 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.376829 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c"} err="failed to get container status \"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c\": rpc error: code = NotFound desc = could not find container \"006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c\": container with ID starting with 006f01b6cec26c984e0c52cc14a239aed190985d80d8431be4c5120cee49c07c not found: ID does not exist" May 27 17:57:32.407834 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.407794 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:57:32.417204 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:32.417168 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745f556cd7-tskps"] May 27 17:57:34.210447 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:34.210400 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46a94dc-a8c3-468e-9d3e-cba781462c30" path="/var/lib/kubelet/pods/a46a94dc-a8c3-468e-9d3e-cba781462c30/volumes" May 27 17:57:50.605074 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:50.605030 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:57:56.503357 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:57:56.503310 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:58:32.001318 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:58:32.001284 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:58:47.995077 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:58:47.995034 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:59:27.105222 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:59:27.105185 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:59:43.797213 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:59:43.797130 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 17:59:57.793135 ip-10-0-129-78 kubenswrapper[2552]: I0527 17:59:57.793101 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:00:00.140470 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.140437 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665080-r8tps"] May 27 18:00:00.140932 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.140805 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46a94dc-a8c3-468e-9d3e-cba781462c30" containerName="console" May 27 18:00:00.140932 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.140816 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46a94dc-a8c3-468e-9d3e-cba781462c30" containerName="console" May 27 18:00:00.140932 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.140898 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a46a94dc-a8c3-468e-9d3e-cba781462c30" containerName="console" May 27 18:00:00.144036 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.144019 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:00.146847 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.146825 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bvb88\"" May 27 18:00:00.160250 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.160227 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665080-r8tps"] May 27 18:00:00.188960 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.188924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8q8n\" (UniqueName: \"kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n\") pod \"maas-api-key-cleanup-29665080-r8tps\" (UID: \"84a1355b-59ea-42bb-b47d-e3e944699dc7\") " pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:00.289395 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.289362 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8q8n\" (UniqueName: \"kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n\") pod \"maas-api-key-cleanup-29665080-r8tps\" (UID: \"84a1355b-59ea-42bb-b47d-e3e944699dc7\") " pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:00.300788 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.300754 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8q8n\" (UniqueName: \"kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n\") pod \"maas-api-key-cleanup-29665080-r8tps\" (UID: \"84a1355b-59ea-42bb-b47d-e3e944699dc7\") " pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:00.453408 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.453326 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:00.586706 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.586674 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665080-r8tps"] May 27 18:00:00.587947 ip-10-0-129-78 kubenswrapper[2552]: W0527 18:00:00.587922 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a1355b_59ea_42bb_b47d_e3e944699dc7.slice/crio-c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0 WatchSource:0}: Error finding container c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0: Status 404 returned error can't find the container with id c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0 May 27 18:00:00.589796 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.589779 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:00:00.939184 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:00.939142 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" event={"ID":"84a1355b-59ea-42bb-b47d-e3e944699dc7","Type":"ContainerStarted","Data":"c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0"} May 27 18:00:13.903704 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:13.903666 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:00:13.996318 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:13.996279 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" event={"ID":"84a1355b-59ea-42bb-b47d-e3e944699dc7","Type":"ContainerStarted","Data":"78982421332bf5671adef945e9e51b74e269c8069e1e69abc40714cfb3e299e3"} May 27 18:00:14.013845 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:14.013797 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" podStartSLOduration=1.059260693 podStartE2EDuration="14.013779649s" podCreationTimestamp="2026-05-27 18:00:00 +0000 UTC" firstStartedPulling="2026-05-27 18:00:00.589935544 +0000 UTC m=+1003.026267574" lastFinishedPulling="2026-05-27 18:00:13.5444545 +0000 UTC m=+1015.980786530" observedRunningTime="2026-05-27 18:00:14.013416052 +0000 UTC m=+1016.449748104" watchObservedRunningTime="2026-05-27 18:00:14.013779649 +0000 UTC m=+1016.450111703" May 27 18:00:15.001448 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:15.001409 2552 generic.go:358] "Generic (PLEG): container finished" podID="84a1355b-59ea-42bb-b47d-e3e944699dc7" containerID="78982421332bf5671adef945e9e51b74e269c8069e1e69abc40714cfb3e299e3" exitCode=0 May 27 18:00:15.001860 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:15.001458 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" event={"ID":"84a1355b-59ea-42bb-b47d-e3e944699dc7","Type":"ContainerDied","Data":"78982421332bf5671adef945e9e51b74e269c8069e1e69abc40714cfb3e299e3"} May 27 18:00:16.132943 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:16.132916 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:16.235732 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:16.235702 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8q8n\" (UniqueName: \"kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n\") pod \"84a1355b-59ea-42bb-b47d-e3e944699dc7\" (UID: \"84a1355b-59ea-42bb-b47d-e3e944699dc7\") " May 27 18:00:16.237889 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:16.237851 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n" (OuterVolumeSpecName: "kube-api-access-f8q8n") pod "84a1355b-59ea-42bb-b47d-e3e944699dc7" (UID: "84a1355b-59ea-42bb-b47d-e3e944699dc7"). InnerVolumeSpecName "kube-api-access-f8q8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:00:16.337299 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:16.337209 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8q8n\" (UniqueName: \"kubernetes.io/projected/84a1355b-59ea-42bb-b47d-e3e944699dc7-kube-api-access-f8q8n\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 18:00:17.012858 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:17.012823 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" event={"ID":"84a1355b-59ea-42bb-b47d-e3e944699dc7","Type":"ContainerDied","Data":"c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0"} May 27 18:00:17.012858 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:17.012849 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665080-r8tps" May 27 18:00:17.012858 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:00:17.012857 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7744358991437a11cfe7ba33f239ef102e7386c43824df6fd9e6ffed40141f0" May 27 18:01:10.298808 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:01:10.298727 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:01:20.215531 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:01:20.215492 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:01:36.921879 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:01:36.921841 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:01:45.706521 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:01:45.706482 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:02:01.591297 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:02:01.591260 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:02:10.934904 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:02:10.934865 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:02:42.796051 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:02:42.795965 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:02:51.598640 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:02:51.598605 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:03:00.389323 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:03:00.389286 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:03:08.517774 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:03:08.517734 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:03:17.205732 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:03:17.205701 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:03:34.499038 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:03:34.498998 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:03:45.494397 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:03:45.494354 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:04:32.394658 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:04:32.394625 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:04:37.316678 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:04:37.316644 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:04:44.291709 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:04:44.291663 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:04:52.895187 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:04:52.895141 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:02.393592 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:02.393537 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:10.592006 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:10.591965 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:18.895445 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:18.895408 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:23.993964 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:23.993915 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:27.896165 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:27.891200 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:37.096181 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:37.096144 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:45.119161 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:45.119125 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:05:54.508985 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:05:54.508944 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:02.720657 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:02.720615 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:12.211346 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:12.211311 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:20.191420 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:20.191376 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:29.294529 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:29.294494 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:37.092256 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:37.092218 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:47.199521 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:47.199482 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:06:55.191573 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:06:55.191522 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:09:15.199768 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:09:15.199733 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:09:20.997389 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:09:20.997338 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:09:44.890391 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:09:44.890351 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:09:51.491252 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:09:51.491210 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:01.694362 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:01.694327 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:11.585546 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:11.585464 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:20.588994 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:20.588962 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:31.890963 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:31.890927 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:39.686391 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:39.686346 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:10:50.593194 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:10:50.593158 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:11:00.094175 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:11:00.094142 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:11:09.480873 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:11:09.480837 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:11:19.595490 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:11:19.595451 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:11:52.109029 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:11:52.108944 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:12:35.087588 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:12:35.087539 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:12:43.288288 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:12:43.288252 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:12:52.303649 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:12:52.303615 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:00.104304 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:00.104263 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:09.793422 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:09.793334 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:19.692710 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:19.692671 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:28.686747 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:28.686712 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:36.897902 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:36.897858 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:44.989959 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:44.989921 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:13:52.897541 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:13:52.897500 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:01.686097 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:01.686060 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:12.296306 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:12.296269 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:30.194813 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:30.194769 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:38.495428 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:38.495343 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:47.994232 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:47.994187 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:14:55.890519 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:14:55.890484 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:00.142831 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.142790 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665095-dt7mg"] May 27 18:15:00.143203 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.143144 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a1355b-59ea-42bb-b47d-e3e944699dc7" containerName="cleanup" May 27 18:15:00.143203 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.143155 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a1355b-59ea-42bb-b47d-e3e944699dc7" containerName="cleanup" May 27 18:15:00.143278 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.143217 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="84a1355b-59ea-42bb-b47d-e3e944699dc7" containerName="cleanup" May 27 18:15:00.146159 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.146142 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:00.148836 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.148819 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bvb88\"" May 27 18:15:00.161903 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.161873 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665095-dt7mg"] May 27 18:15:00.233121 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.233079 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxtg\" (UniqueName: \"kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg\") pod \"maas-api-key-cleanup-29665095-dt7mg\" (UID: \"65cad4b2-c334-4fb5-8941-33a8fad0af96\") " pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:00.333704 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.333672 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxtg\" (UniqueName: \"kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg\") pod \"maas-api-key-cleanup-29665095-dt7mg\" (UID: \"65cad4b2-c334-4fb5-8941-33a8fad0af96\") " pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:00.342675 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.342653 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxtg\" (UniqueName: \"kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg\") pod \"maas-api-key-cleanup-29665095-dt7mg\" (UID: \"65cad4b2-c334-4fb5-8941-33a8fad0af96\") " pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:00.456383 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.456311 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:00.584768 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.584740 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665095-dt7mg"] May 27 18:15:00.586718 ip-10-0-129-78 kubenswrapper[2552]: W0527 18:15:00.586692 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cad4b2_c334_4fb5_8941_33a8fad0af96.slice/crio-99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421 WatchSource:0}: Error finding container 99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421: Status 404 returned error can't find the container with id 99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421 May 27 18:15:00.588476 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:00.588461 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:15:01.433469 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:01.433435 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" event={"ID":"65cad4b2-c334-4fb5-8941-33a8fad0af96","Type":"ContainerStarted","Data":"abf85861949d19a4a7c7d1bca93463380573ea4dbeec7275b01e48603169240f"} May 27 18:15:01.433469 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:01.433471 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" event={"ID":"65cad4b2-c334-4fb5-8941-33a8fad0af96","Type":"ContainerStarted","Data":"99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421"} May 27 18:15:01.451580 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:01.451525 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" podStartSLOduration=1.451511298 podStartE2EDuration="1.451511298s" podCreationTimestamp="2026-05-27 18:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:15:01.448565233 +0000 UTC m=+1903.884897278" watchObservedRunningTime="2026-05-27 18:15:01.451511298 +0000 UTC m=+1903.887843327" May 27 18:15:02.438164 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:02.438133 2552 generic.go:358] "Generic (PLEG): container finished" podID="65cad4b2-c334-4fb5-8941-33a8fad0af96" containerID="abf85861949d19a4a7c7d1bca93463380573ea4dbeec7275b01e48603169240f" exitCode=0 May 27 18:15:02.438540 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:02.438225 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" event={"ID":"65cad4b2-c334-4fb5-8941-33a8fad0af96","Type":"ContainerDied","Data":"abf85861949d19a4a7c7d1bca93463380573ea4dbeec7275b01e48603169240f"} May 27 18:15:03.571427 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:03.571405 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:03.666911 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:03.666873 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnxtg\" (UniqueName: \"kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg\") pod \"65cad4b2-c334-4fb5-8941-33a8fad0af96\" (UID: \"65cad4b2-c334-4fb5-8941-33a8fad0af96\") " May 27 18:15:03.668946 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:03.668911 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg" (OuterVolumeSpecName: "kube-api-access-dnxtg") pod "65cad4b2-c334-4fb5-8941-33a8fad0af96" (UID: "65cad4b2-c334-4fb5-8941-33a8fad0af96"). InnerVolumeSpecName "kube-api-access-dnxtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:15:03.767697 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:03.767611 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnxtg\" (UniqueName: \"kubernetes.io/projected/65cad4b2-c334-4fb5-8941-33a8fad0af96-kube-api-access-dnxtg\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\"" May 27 18:15:04.447099 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:04.447065 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" May 27 18:15:04.447271 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:04.447071 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665095-dt7mg" event={"ID":"65cad4b2-c334-4fb5-8941-33a8fad0af96","Type":"ContainerDied","Data":"99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421"} May 27 18:15:04.447271 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:04.447166 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99044875bbaad8962ccd007deb23c51cd4f383f33e0e61a16b331c01c75a1421" May 27 18:15:13.187512 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:13.187479 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:21.884317 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:21.884282 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:29.682243 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:29.682208 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:37.986459 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:37.986407 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:47.583930 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:47.583893 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:15:55.684944 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:15:55.684910 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:04.193394 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:04.193341 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:15.591721 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:15.591603 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:24.392794 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:24.392754 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:38.383684 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:38.383645 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:47.492242 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:47.492208 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:16:53.996236 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:16:53.996204 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:03.493909 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:03.493874 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:12.391508 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:12.391472 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:28.089746 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:28.089704 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:36.290094 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:36.290057 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:45.133795 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:45.133716 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:17:53.311570 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:17:53.311530 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:18:16.983258 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:16.983218 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:18:29.988816 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:29.988781 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5xs4m"] May 27 18:18:38.085534 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:38.085505 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665080-r8tps_84a1355b-59ea-42bb-b47d-e3e944699dc7/cleanup/0.log" May 27 18:18:38.203847 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:38.203817 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665095-dt7mg_65cad4b2-c334-4fb5-8941-33a8fad0af96/cleanup/0.log" May 27 18:18:38.808784 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:38.808754 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-sztjb_9ec65a0a-9729-4328-95af-7851cf40daa9/manager/0.log" May 27 18:18:39.699101 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.699071 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/util/0.log" May 27 18:18:39.705945 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.705913 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/pull/0.log" May 27 18:18:39.712433 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.712408 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/extract/0.log" May 27 18:18:39.825492 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.825462 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/util/0.log" May 27 18:18:39.831606 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.831580 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/pull/0.log" May 27 18:18:39.837140 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.837118 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/extract/0.log" May 27 18:18:39.950112 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.950048 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/util/0.log" May 27 18:18:39.956004 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.955984 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/pull/0.log" May 27 18:18:39.961782 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:39.961765 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/extract/0.log" May 27 18:18:40.078349 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.078327 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/pull/0.log" May 27 18:18:40.083859 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.083812 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/extract/0.log" May 27 18:18:40.088791 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.088775 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/util/0.log" May 27 18:18:40.333220 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.333132 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8rnzv_d87784bf-5ce9-4178-8f01-82ddd2197974/manager/0.log" May 27 18:18:40.547883 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.547853 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-trvrw_57164937-4c14-4942-8863-5dc8794c749a/kuadrant-console-plugin/0.log" May 27 18:18:40.680070 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.680039 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q4tq9_2bcf6513-2cf6-4c08-8ceb-969cae376a0a/registry-server/0.log" May 27 18:18:40.926385 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:40.926353 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5xs4m_582e6685-e4c3-4b04-8ed4-5ad86e73558e/limitador/0.log" May 27 18:18:41.376420 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:41.376388 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8vm6bb_e52ceff9-d3e7-4bd1-a505-9c961dce15bd/istio-proxy/0.log" May 27 18:18:41.821893 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:41.821815 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-ffdm9_f1090a3d-cb29-43a4-b283-45193a62e50a/istio-proxy/0.log" May 27 18:18:42.627187 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:42.627155 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-7r9gt_c3715dc2-acc2-4187-9284-4311459578c3/storage-initializer/0.log" May 27 18:18:42.634051 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:42.634023 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-7r9gt_c3715dc2-acc2-4187-9284-4311459578c3/main/0.log" May 27 18:18:46.504109 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.504075 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d9xm9/must-gather-nh7bm"] May 27 18:18:46.504479 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.504441 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65cad4b2-c334-4fb5-8941-33a8fad0af96" containerName="cleanup" May 27 18:18:46.504479 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.504451 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="65cad4b2-c334-4fb5-8941-33a8fad0af96" containerName="cleanup" May 27 18:18:46.504572 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.504505 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="65cad4b2-c334-4fb5-8941-33a8fad0af96" containerName="cleanup" May 27 18:18:46.507824 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.507804 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.511161 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.511139 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"kube-root-ca.crt\"" May 27 18:18:46.512193 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.512168 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d9xm9\"/\"default-dockercfg-z8mxt\"" May 27 18:18:46.512303 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.512201 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"openshift-service-ca.crt\"" May 27 18:18:46.522233 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.522212 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/must-gather-nh7bm"] May 27 18:18:46.534362 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.534335 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b57632-6998-4797-95db-4ad01e53d43b-must-gather-output\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.534472 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.534446 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrfmc\" (UniqueName: \"kubernetes.io/projected/18b57632-6998-4797-95db-4ad01e53d43b-kube-api-access-qrfmc\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.635865 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.635822 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b57632-6998-4797-95db-4ad01e53d43b-must-gather-output\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.636043 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.635953 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrfmc\" (UniqueName: \"kubernetes.io/projected/18b57632-6998-4797-95db-4ad01e53d43b-kube-api-access-qrfmc\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.636248 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.636226 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b57632-6998-4797-95db-4ad01e53d43b-must-gather-output\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.649291 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.649262 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrfmc\" (UniqueName: \"kubernetes.io/projected/18b57632-6998-4797-95db-4ad01e53d43b-kube-api-access-qrfmc\") pod \"must-gather-nh7bm\" (UID: \"18b57632-6998-4797-95db-4ad01e53d43b\") " pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.816742 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.816659 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" May 27 18:18:46.948084 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:46.948046 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/must-gather-nh7bm"] May 27 18:18:46.951484 ip-10-0-129-78 kubenswrapper[2552]: W0527 18:18:46.951455 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18b57632_6998_4797_95db_4ad01e53d43b.slice/crio-789cb2f94a2203337354d0cf0146ce261ad66cb6ad2ff0f86fd78825ca24ba9d WatchSource:0}: Error finding container 789cb2f94a2203337354d0cf0146ce261ad66cb6ad2ff0f86fd78825ca24ba9d: Status 404 returned error can't find the container with id 789cb2f94a2203337354d0cf0146ce261ad66cb6ad2ff0f86fd78825ca24ba9d May 27 18:18:47.331271 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:47.331236 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" event={"ID":"18b57632-6998-4797-95db-4ad01e53d43b","Type":"ContainerStarted","Data":"789cb2f94a2203337354d0cf0146ce261ad66cb6ad2ff0f86fd78825ca24ba9d"} May 27 18:18:48.337253 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:48.337219 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" event={"ID":"18b57632-6998-4797-95db-4ad01e53d43b","Type":"ContainerStarted","Data":"a5fb9121a14c787a41ca8e8bdaaaa174fb86c597759c39f4fcc1c6aba3b722fd"} May 27 18:18:48.337253 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:48.337257 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" event={"ID":"18b57632-6998-4797-95db-4ad01e53d43b","Type":"ContainerStarted","Data":"bdea117a71abf5079776193f339123b9522ad1c1e8478af841c23208f7b22f2c"} May 27 18:18:48.357507 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:48.357445 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d9xm9/must-gather-nh7bm" podStartSLOduration=1.46785775 podStartE2EDuration="2.357425098s" podCreationTimestamp="2026-05-27 18:18:46 +0000 UTC" firstStartedPulling="2026-05-27 18:18:46.953268451 +0000 UTC m=+2129.389600484" lastFinishedPulling="2026-05-27 18:18:47.842835799 +0000 UTC m=+2130.279167832" observedRunningTime="2026-05-27 18:18:48.35265597 +0000 UTC m=+2130.788988023" watchObservedRunningTime="2026-05-27 18:18:48.357425098 +0000 UTC m=+2130.793757152" May 27 18:18:49.454749 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:49.454719 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g952z_f02c97f8-6d99-4232-adff-ee0f8297efc7/global-pull-secret-syncer/0.log" May 27 18:18:49.578136 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:49.578097 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnzts_f43138ba-5f8e-44c8-bc55-8af37266108e/konnectivity-agent/0.log" May 27 18:18:49.648546 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:49.648497 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-78.ec2.internal_d949e550394461522a2d1d8947c3eac2/haproxy/0.log" May 27 18:18:53.659128 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.659093 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/extract/0.log" May 27 18:18:53.679414 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.679379 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/util/0.log" May 27 18:18:53.699897 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.699872 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nznk_a38e9421-be8c-43e9-92f1-97e8a1fda01a/pull/0.log" May 27 18:18:53.725701 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.725663 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/extract/0.log" May 27 18:18:53.745816 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.745785 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/util/0.log" May 27 18:18:53.766121 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.766024 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04dwpb_505eb904-1a17-4e44-87bf-425c00d339ec/pull/0.log" May 27 18:18:53.791454 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.791418 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/extract/0.log" May 27 18:18:53.811490 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.811459 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/util/0.log" May 27 18:18:53.832769 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.832737 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737zj5z_c439b94e-5d8c-40fd-be22-1ac4f99f279d/pull/0.log" May 27 18:18:53.869615 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.869591 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/extract/0.log" May 27 18:18:53.889821 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.889789 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/util/0.log" May 27 18:18:53.914026 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:53.913932 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19cdmq_f0c49494-fb67-49b8-95cb-41d978684640/pull/0.log" May 27 18:18:54.157246 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:54.157216 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8rnzv_d87784bf-5ce9-4178-8f01-82ddd2197974/manager/0.log" May 27 18:18:54.206215 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:54.206129 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-trvrw_57164937-4c14-4942-8863-5dc8794c749a/kuadrant-console-plugin/0.log" May 27 18:18:54.244173 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:54.244138 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q4tq9_2bcf6513-2cf6-4c08-8ceb-969cae376a0a/registry-server/0.log" May 27 18:18:54.331317 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:54.331289 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5xs4m_582e6685-e4c3-4b04-8ed4-5ad86e73558e/limitador/0.log" May 27 18:18:56.045396 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.045357 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6zclq_d480af2c-5611-4642-a4d0-4d325fec8421/kube-state-metrics/0.log" May 27 18:18:56.073824 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.073798 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6zclq_d480af2c-5611-4642-a4d0-4d325fec8421/kube-rbac-proxy-main/0.log" May 27 18:18:56.093686 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.093651 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6zclq_d480af2c-5611-4642-a4d0-4d325fec8421/kube-rbac-proxy-self/0.log" May 27 18:18:56.259279 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.259249 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-drng8_cbe6b288-9aaf-40e4-a654-a287b447baa1/node-exporter/0.log" May 27 18:18:56.277234 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.277205 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-drng8_cbe6b288-9aaf-40e4-a654-a287b447baa1/kube-rbac-proxy/0.log" May 27 18:18:56.296900 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.296799 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-drng8_cbe6b288-9aaf-40e4-a654-a287b447baa1/init-textfile/0.log" May 27 18:18:56.637477 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.637442 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-t7cbj_69810011-7ea1-4bad-a824-445e8b13d129/prometheus-operator/0.log" May 27 18:18:56.655219 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.655176 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-t7cbj_69810011-7ea1-4bad-a824-445e8b13d129/kube-rbac-proxy/0.log" May 27 18:18:56.712101 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.712068 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77fcb8bb67-z2pzv_e0af9c0d-76d0-461e-ad3d-59113d3ee94f/telemeter-client/0.log" May 27 18:18:56.730624 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.730586 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77fcb8bb67-z2pzv_e0af9c0d-76d0-461e-ad3d-59113d3ee94f/reload/0.log" May 27 18:18:56.749910 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.749884 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77fcb8bb67-z2pzv_e0af9c0d-76d0-461e-ad3d-59113d3ee94f/kube-rbac-proxy/0.log" May 27 18:18:56.781486 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.781442 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/thanos-query/0.log" May 27 18:18:56.800426 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.800400 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/kube-rbac-proxy-web/0.log" May 27 18:18:56.821539 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.821507 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/kube-rbac-proxy/0.log" May 27 18:18:56.839772 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.839743 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/prom-label-proxy/0.log" May 27 18:18:56.859687 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.859655 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/kube-rbac-proxy-rules/0.log" May 27 18:18:56.879811 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:56.879780 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597b4f49-48hmn_6a9fa8eb-8660-496b-b8d9-bf8cbd8e30b4/kube-rbac-proxy-metrics/0.log" May 27 18:18:58.033459 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.033423 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j"] May 27 18:18:58.040700 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.040671 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.043922 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.043893 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j"] May 27 18:18:58.150064 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.150032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-sys\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.150242 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.150090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9688w\" (UniqueName: \"kubernetes.io/projected/81b27afc-6adc-4859-abc7-389342be10fb-kube-api-access-9688w\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.150242 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.150167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-proc\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.150242 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.150227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-lib-modules\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.150399 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.150267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-podres\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.251252 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251218 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-lib-modules\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.251520 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-lib-modules\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.251700 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251496 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-podres\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.251846 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251832 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-sys\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.252080 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.252064 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9688w\" (UniqueName: \"kubernetes.io/projected/81b27afc-6adc-4859-abc7-389342be10fb-kube-api-access-9688w\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.252524 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.252507 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-proc\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.252720 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.252701 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-proc\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.252825 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-sys\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.252914 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.251620 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81b27afc-6adc-4859-abc7-389342be10fb-podres\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.261296 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.261275 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9688w\" (UniqueName: \"kubernetes.io/projected/81b27afc-6adc-4859-abc7-389342be10fb-kube-api-access-9688w\") pod \"perf-node-gather-daemonset-n7w8j\" (UID: \"81b27afc-6adc-4859-abc7-389342be10fb\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.357696 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.357664 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:58.532001 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.531970 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j"] May 27 18:18:58.535240 ip-10-0-129-78 kubenswrapper[2552]: W0527 18:18:58.534315 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81b27afc_6adc_4859_abc7_389342be10fb.slice/crio-7334e8784dbdc29ab801b2fed90bf75589d6a4ed52bfbfedf5b4035450e56e08 WatchSource:0}: Error finding container 7334e8784dbdc29ab801b2fed90bf75589d6a4ed52bfbfedf5b4035450e56e08: Status 404 returned error can't find the container with id 7334e8784dbdc29ab801b2fed90bf75589d6a4ed52bfbfedf5b4035450e56e08 May 27 18:18:58.975727 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:58.975643 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bbc979b75-dxmmf_2d9810e3-27ea-4432-8bf2-a3e392b2abfa/console/0.log" May 27 18:18:59.397166 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:59.397131 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" event={"ID":"81b27afc-6adc-4859-abc7-389342be10fb","Type":"ContainerStarted","Data":"e38093cb96cbea9599f1451a84e0f4603c9aecc1f81663f97f15e5cf9fbdcf45"} May 27 18:18:59.397166 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:59.397171 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" event={"ID":"81b27afc-6adc-4859-abc7-389342be10fb","Type":"ContainerStarted","Data":"7334e8784dbdc29ab801b2fed90bf75589d6a4ed52bfbfedf5b4035450e56e08"} May 27 18:18:59.397718 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:59.397267 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:18:59.413825 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:18:59.413780 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" podStartSLOduration=1.413765371 podStartE2EDuration="1.413765371s" podCreationTimestamp="2026-05-27 18:18:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:18:59.41159865 +0000 UTC m=+2141.847930704" watchObservedRunningTime="2026-05-27 18:18:59.413765371 +0000 UTC m=+2141.850097422" May 27 18:19:00.431144 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:00.431115 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qml4g_01738e52-7941-4f85-bfe9-5a98bb5560a8/dns/0.log" May 27 18:19:00.448580 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:00.448539 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qml4g_01738e52-7941-4f85-bfe9-5a98bb5560a8/kube-rbac-proxy/0.log" May 27 18:19:00.528274 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:00.528250 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbbg7_e12677bd-7bd2-485c-93ff-47998853b2fa/dns-node-resolver/0.log" May 27 18:19:01.035055 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:01.035025 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-trt7k_62f2e298-fad1-49de-ba76-cc0747aeb067/node-ca/0.log" May 27 18:19:01.861352 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:01.861322 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8vm6bb_e52ceff9-d3e7-4bd1-a505-9c961dce15bd/istio-proxy/0.log" May 27 18:19:02.084351 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:02.084311 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-ffdm9_f1090a3d-cb29-43a4-b283-45193a62e50a/istio-proxy/0.log" May 27 18:19:02.733824 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:02.733792 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpvtv_01620d2b-48aa-444d-a92f-9014fe394cd6/serve-healthcheck-canary/0.log" May 27 18:19:03.349469 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:03.349438 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxn8b_544ef915-226d-4dab-bd97-1ff3ad2c30a1/kube-rbac-proxy/0.log" May 27 18:19:03.366509 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:03.366488 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxn8b_544ef915-226d-4dab-bd97-1ff3ad2c30a1/exporter/0.log" May 27 18:19:03.386113 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:03.386085 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxn8b_544ef915-226d-4dab-bd97-1ff3ad2c30a1/extractor/0.log" May 27 18:19:05.328248 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:05.328218 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665080-r8tps_84a1355b-59ea-42bb-b47d-e3e944699dc7/cleanup/0.log" May 27 18:19:05.348849 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:05.348825 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665095-dt7mg_65cad4b2-c334-4fb5-8941-33a8fad0af96/cleanup/0.log" May 27 18:19:05.413892 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:05.413845 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-n7w8j" May 27 18:19:05.530904 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:05.530869 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-sztjb_9ec65a0a-9729-4328-95af-7851cf40daa9/manager/0.log" May 27 18:19:06.809692 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:06.809657 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78df8cc544-jmct8_ad3df171-64f0-4077-938c-8f17d602d668/manager/0.log" May 27 18:19:06.842180 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:06.842149 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-q9xgb_c5367a03-085a-47e5-ba67-93f2c0027bd2/openshift-lws-operator/0.log" May 27 18:19:11.235504 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:11.235466 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dbclm_0a790967-a53a-4a9a-a33c-8158e206003c/migrator/0.log" May 27 18:19:11.253797 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:11.253771 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-dbclm_0a790967-a53a-4a9a-a33c-8158e206003c/graceful-termination/0.log" May 27 18:19:12.970423 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:12.970396 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/kube-multus-additional-cni-plugins/0.log" May 27 18:19:12.988174 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:12.988148 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/egress-router-binary-copy/0.log" May 27 18:19:13.006184 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.006159 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/cni-plugins/0.log" May 27 18:19:13.026360 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.026339 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/bond-cni-plugin/0.log" May 27 18:19:13.044181 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.044150 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/routeoverride-cni/0.log" May 27 18:19:13.062282 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.062263 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/whereabouts-cni-bincopy/0.log" May 27 18:19:13.079735 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.079715 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfg7j_d62dbec4-8cf6-4361-be58-737d0279933b/whereabouts-cni/0.log" May 27 18:19:13.145208 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.145178 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t96s6_b20d8ac3-7485-4b11-b53b-c9c2b06413c3/kube-multus/0.log" May 27 18:19:13.205089 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.205066 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7nwgk_d2a39535-6a8b-4f87-9f0b-65535fe15f3d/network-metrics-daemon/0.log" May 27 18:19:13.221133 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:13.221070 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7nwgk_d2a39535-6a8b-4f87-9f0b-65535fe15f3d/kube-rbac-proxy/0.log" May 27 18:19:14.323664 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.323630 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/ovn-controller/0.log" May 27 18:19:14.360572 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.360533 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/ovn-acl-logging/0.log" May 27 18:19:14.377581 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.377520 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/kube-rbac-proxy-node/0.log" May 27 18:19:14.396286 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.396264 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/kube-rbac-proxy-ovn-metrics/0.log" May 27 18:19:14.416171 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.416149 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/northd/0.log" May 27 18:19:14.434094 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.434066 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/nbdb/0.log" May 27 18:19:14.452735 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.452714 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/sbdb/0.log" May 27 18:19:14.637356 ip-10-0-129-78 kubenswrapper[2552]: I0527 18:19:14.637331 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdw22_8e654f21-7f83-4278-b031-3956ca8229d7/ovnkube-controller/0.log"