May 21 02:05:04.247308 ip-10-0-130-115 systemd[1]: Starting Kubernetes Kubelet... May 21 02:05:04.747147 ip-10-0-130-115 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:04.747147 ip-10-0-130-115 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 02:05:04.747147 ip-10-0-130-115 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:04.747147 ip-10-0-130-115 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 02:05:04.747147 ip-10-0-130-115 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:04.749248 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.749154 2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 02:05:04.757051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757024 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:04.757051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757043 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:04.757051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757047 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:04.757051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757051 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:04.757051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757057 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757061 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757064 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757067 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757070 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757074 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757077 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757079 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757082 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757085 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757089 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757092 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757096 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757101 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757103 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757106 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757109 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757112 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757115 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757117 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:04.757249 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757120 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757123 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757126 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757128 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757131 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757136 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757139 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757142 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757144 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757147 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757149 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757152 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757155 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757158 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757163 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757165 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757168 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757173 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757176 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757179 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:04.757728 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757182 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757184 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757188 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757193 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757196 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757198 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757201 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757204 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757206 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757209 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757214 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757217 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757220 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757223 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757225 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757228 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757231 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757233 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757236 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757239 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:04.758236 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757242 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757245 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757249 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757252 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757255 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757258 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757262 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757265 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757268 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757271 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757273 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757276 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757279 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757283 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757289 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757292 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757295 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757299 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757302 2552 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:04.758731 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757305 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757308 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757310 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757929 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757935 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757941 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757943 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757946 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757949 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757951 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757982 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757987 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757991 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757994 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.757997 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758001 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758004 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758007 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758012 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:04.759204 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758015 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758018 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758020 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758023 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758026 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758028 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758031 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758034 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758037 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758039 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758043 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758048 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758052 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758056 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758059 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758062 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758066 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758069 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758072 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:04.759666 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758075 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758078 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758081 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758083 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758089 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758092 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758094 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758097 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758100 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758102 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758105 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758108 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758111 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758114 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758116 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758119 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758121 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758126 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758129 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758131 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:04.760247 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758134 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758137 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758139 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758142 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758145 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758148 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758150 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758153 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758156 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758162 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758165 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758168 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758171 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758173 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758176 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758178 2552 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758181 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758184 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758186 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758190 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:04.760753 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758193 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758199 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758202 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758205 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758207 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758210 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758212 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758215 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758217 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758220 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.758223 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760054 2552 flags.go:64] FLAG: --address="0.0.0.0" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760201 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760210 2552 flags.go:64] FLAG: --anonymous-auth="true" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760215 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760219 2552 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760223 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760227 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760233 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760236 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760240 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 02:05:04.761262 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760261 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760266 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760270 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760273 2552 flags.go:64] FLAG: --cgroup-root="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760276 2552 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760280 2552 flags.go:64] FLAG: --client-ca-file="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760283 2552 flags.go:64] FLAG: --cloud-config="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760286 2552 flags.go:64] FLAG: --cloud-provider="external" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760289 2552 flags.go:64] FLAG: --cluster-dns="[]" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760295 2552 flags.go:64] FLAG: --cluster-domain="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760300 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760303 2552 flags.go:64] FLAG: --config-dir="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760308 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760313 2552 flags.go:64] FLAG: --container-log-max-files="5" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760319 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760322 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760325 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760330 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760333 2552 flags.go:64] FLAG: --contention-profiling="false" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760338 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760341 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760346 2552 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760351 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760358 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760361 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 02:05:04.761790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760366 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760371 2552 flags.go:64] FLAG: --enable-load-reader="false" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760374 2552 flags.go:64] FLAG: --enable-server="true" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760377 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760382 2552 flags.go:64] FLAG: --event-burst="100" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760386 2552 flags.go:64] FLAG: --event-qps="50" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760389 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760392 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760395 2552 flags.go:64] FLAG: --eviction-hard="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760399 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760402 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760405 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760408 2552 flags.go:64] FLAG: --eviction-soft="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760411 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760413 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760417 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760420 2552 flags.go:64] FLAG: --experimental-mounter-path="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760423 2552 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760426 2552 flags.go:64] FLAG: --fail-swap-on="true" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760429 2552 flags.go:64] FLAG: --feature-gates="" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760437 2552 flags.go:64] FLAG: --file-check-frequency="20s" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760440 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760444 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760448 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760451 2552 flags.go:64] FLAG: --healthz-port="10248" May 21 02:05:04.762427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760454 2552 flags.go:64] FLAG: --help="false" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760457 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-130-115.ec2.internal" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760461 2552 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760464 2552 flags.go:64] FLAG: --http-check-frequency="20s" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760467 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760471 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760475 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760478 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760481 2552 flags.go:64] FLAG: --image-service-endpoint="" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760484 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760488 2552 flags.go:64] FLAG: --kube-api-burst="100" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760492 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760495 2552 flags.go:64] FLAG: --kube-api-qps="50" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760498 2552 flags.go:64] FLAG: --kube-reserved="" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760501 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760504 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760507 2552 flags.go:64] FLAG: --kubelet-cgroups="" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760510 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760512 2552 flags.go:64] FLAG: --lock-file="" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760516 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760518 2552 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760521 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760531 2552 flags.go:64] FLAG: --log-json-split-stream="false" May 21 02:05:04.763055 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760534 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760537 2552 flags.go:64] FLAG: --log-text-split-stream="false" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760540 2552 flags.go:64] FLAG: --logging-format="text" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760543 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760546 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760549 2552 flags.go:64] FLAG: --manifest-url="" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760552 2552 flags.go:64] FLAG: --manifest-url-header="" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760558 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760561 2552 flags.go:64] FLAG: --max-open-files="1000000" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760565 2552 flags.go:64] FLAG: --max-pods="110" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760568 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760571 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760574 2552 flags.go:64] FLAG: --memory-manager-policy="None" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760577 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760580 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760583 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760586 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760595 2552 flags.go:64] FLAG: --node-status-max-images="50" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760598 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760601 2552 flags.go:64] FLAG: --oom-score-adj="-999" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760605 2552 flags.go:64] FLAG: --pod-cidr="" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760608 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760614 2552 flags.go:64] FLAG: --pod-manifest-path="" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760616 2552 flags.go:64] FLAG: --pod-max-pids="-1" May 21 02:05:04.763630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760619 2552 flags.go:64] FLAG: --pods-per-core="0" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760622 2552 flags.go:64] FLAG: --port="10250" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760626 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760629 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec12e506a61aae4d" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760632 2552 flags.go:64] FLAG: --qos-reserved="" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760635 2552 flags.go:64] FLAG: --read-only-port="10255" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760638 2552 flags.go:64] FLAG: --register-node="true" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760641 2552 flags.go:64] FLAG: --register-schedulable="true" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760644 2552 flags.go:64] FLAG: --register-with-taints="" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760648 2552 flags.go:64] FLAG: --registry-burst="10" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760651 2552 flags.go:64] FLAG: --registry-qps="5" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760654 2552 flags.go:64] FLAG: --reserved-cpus="" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760657 2552 flags.go:64] FLAG: --reserved-memory="" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760661 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760664 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760667 2552 flags.go:64] FLAG: --rotate-certificates="false" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760670 2552 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760673 2552 flags.go:64] FLAG: --runonce="false" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760676 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760679 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760682 2552 flags.go:64] FLAG: --seccomp-default="false" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760685 2552 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760687 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760691 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760695 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760698 2552 flags.go:64] FLAG: --storage-driver-password="root" May 21 02:05:04.764268 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760701 2552 flags.go:64] FLAG: --storage-driver-secure="false" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760704 2552 flags.go:64] FLAG: --storage-driver-table="stats" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760707 2552 flags.go:64] FLAG: --storage-driver-user="root" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760711 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760714 2552 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760717 2552 flags.go:64] FLAG: --system-cgroups="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760720 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760726 2552 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760728 2552 flags.go:64] FLAG: --tls-cert-file="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760731 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760736 2552 flags.go:64] FLAG: --tls-min-version="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760739 2552 flags.go:64] FLAG: --tls-private-key-file="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760742 2552 flags.go:64] FLAG: --topology-manager-policy="none" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760745 2552 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760747 2552 flags.go:64] FLAG: --topology-manager-scope="container" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760750 2552 flags.go:64] FLAG: --v="2" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760754 2552 flags.go:64] FLAG: --version="false" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760759 2552 flags.go:64] FLAG: --vmodule="" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760764 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.760767 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760879 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760883 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760887 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760890 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:04.764893 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760893 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760897 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760900 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760903 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760905 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760910 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760913 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760916 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760918 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760921 2552 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760924 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760927 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760933 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760937 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760941 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760944 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760947 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760950 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760952 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:04.765524 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760955 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760957 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760973 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760976 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760978 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760981 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760984 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760986 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760990 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760992 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760995 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.760997 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761000 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761003 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761005 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761008 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761011 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761013 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761018 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:04.766031 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761020 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761023 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761026 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761028 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761031 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761034 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761036 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761039 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761042 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761044 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761047 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761049 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761052 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761054 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761057 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761059 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761061 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761064 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761066 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761069 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:04.766496 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761071 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761074 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761076 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761079 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761081 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761084 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761086 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761089 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761091 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761094 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761096 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761100 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761103 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761105 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761108 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761110 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761113 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761115 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761118 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761120 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:04.767006 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761123 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:04.767514 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761126 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:04.767514 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761129 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:04.767514 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.761133 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:04.767514 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.762081 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:04.768980 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.768944 2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 02:05:04.768980 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.768980 2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769058 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769066 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769072 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769077 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769081 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769085 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769089 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769093 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769097 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769102 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769106 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769111 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769115 2552 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769119 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769123 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769128 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769132 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769136 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769140 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:04.769132 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769144 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769148 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769152 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769156 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769160 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769165 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769169 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769174 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769179 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769183 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769188 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769192 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769197 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769201 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769206 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769210 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769214 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769218 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769222 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:04.770035 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769226 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769231 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769235 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769240 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769244 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769248 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769252 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769257 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769261 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769265 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769269 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769273 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769278 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769282 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769286 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769291 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769295 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769299 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769304 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:04.770647 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769308 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769312 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769316 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769321 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769325 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769330 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769334 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769340 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769344 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769349 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769353 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769360 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769365 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769370 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769375 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769379 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769386 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769391 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769396 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769400 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:04.771336 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769404 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769408 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769412 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769416 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769421 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769426 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769430 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769434 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769439 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.769447 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769599 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769608 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769613 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769617 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769622 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769626 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:04.771898 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769630 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769635 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769639 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769644 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769649 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769653 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769657 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769661 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769665 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769668 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769672 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769676 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769681 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769687 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769694 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769698 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769703 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769707 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769711 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:04.772319 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769715 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769719 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769723 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769727 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769731 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769735 2552 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769739 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769744 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769748 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769752 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769756 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769760 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769765 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769769 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769773 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769777 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769781 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769785 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769790 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769794 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:04.772811 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769798 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769803 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769807 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769811 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769815 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769819 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769823 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769827 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769831 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769837 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769843 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769848 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769852 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769856 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769860 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769865 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769869 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769873 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769877 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:04.773355 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769881 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769885 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769890 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769894 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769899 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769902 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769907 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769911 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769915 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769919 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769923 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769927 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769932 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769937 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769941 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769946 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769950 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769954 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769959 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769982 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:04.773820 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769987 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:04.774388 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:04.769991 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:04.774388 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.769999 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:04.774388 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.770169 2552 server.go:962] "Client rotation is on, will bootstrap in background" May 21 02:05:04.776228 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.776210 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 02:05:04.777374 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.777361 2552 server.go:1019] "Starting client certificate rotation" May 21 02:05:04.777476 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.777460 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 02:05:04.777521 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.777500 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 02:05:04.806166 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.806150 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 02:05:04.807386 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.807359 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 02:05:04.828725 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.828702 2552 log.go:25] "Validated CRI v1 runtime API" May 21 02:05:04.835152 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.835135 2552 log.go:25] "Validated CRI v1 image API" May 21 02:05:04.836644 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.836627 2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 02:05:04.839324 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.839304 2552 fs.go:135] Filesystem UUIDs: map[6ceb7c13-7785-41d3-8521-e3f4f1c7fa30:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8b1b1741-3196-40c1-9be5-23756553a3a9:/dev/nvme0n1p4] May 21 02:05:04.839374 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.839324 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 02:05:04.841414 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.841398 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 02:05:04.843918 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.843815 2552 manager.go:217] Machine: {Timestamp:2026-05-21 02:05:04.843252335 +0000 UTC m=+0.464194295 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3212201 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21cef3b94983aab625e51f60aa0a6b SystemUUID:ec21cef3-b949-83aa-b625-e51f60aa0a6b BootID:335452b1-d53d-4b05-b190-7ec16b54bb35 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:0a:60:45:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:0a:60:45:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:f3:df:d5:8d:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 02:05:04.843918 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.843917 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 02:05:04.844033 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.844010 2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 02:05:04.847008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.846987 2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 02:05:04.847140 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.847012 2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 02:05:04.847186 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.847151 2552 topology_manager.go:138] "Creating topology manager with none policy" May 21 02:05:04.847186 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.847159 2552 container_manager_linux.go:306] "Creating device plugin manager" May 21 02:05:04.847186 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.847167 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 02:05:04.848115 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.848105 2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 02:05:04.849868 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.849858 2552 state_mem.go:36] "Initialized new in-memory state store" May 21 02:05:04.850001 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.849992 2552 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 02:05:04.852828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.852818 2552 kubelet.go:491] "Attempting to sync node with API server" May 21 02:05:04.852859 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.852831 2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 02:05:04.852859 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.852843 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 02:05:04.852859 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.852852 2552 kubelet.go:397] "Adding apiserver pod source" May 21 02:05:04.852859 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.852860 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 02:05:04.854049 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.854035 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 02:05:04.854089 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.854057 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 02:05:04.857504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.857489 2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 02:05:04.859854 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.859838 2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 02:05:04.862044 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862032 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862049 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862056 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862063 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862073 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862079 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862086 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862097 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862105 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 02:05:04.862114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862110 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 02:05:04.862385 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862124 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 02:05:04.862385 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862130 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 02:05:04.862385 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862156 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 02:05:04.862385 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.862165 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 02:05:04.865284 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.865270 2552 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 02:05:04.865341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.865306 2552 server.go:1295] "Started kubelet" May 21 02:05:04.865395 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.865353 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 02:05:04.865502 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.865436 2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 02:05:04.865554 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.865543 2552 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 02:05:04.866241 ip-10-0-130-115 systemd[1]: Started Kubernetes Kubelet. May 21 02:05:04.867086 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.867064 2552 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 02:05:04.867190 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.867149 2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 02:05:04.870251 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.870218 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 02:05:04.870358 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.870256 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 02:05:04.871885 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.871864 2552 server.go:317] "Adding debug handlers to kubelet server" May 21 02:05:04.876019 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.873526 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-115.ec2.internal.18b17264c2024bea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-115.ec2.internal,UID:ip-10-0-130-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-115.ec2.internal,},FirstTimestamp:2026-05-21 02:05:04.86528305 +0000 UTC m=+0.486225010,LastTimestamp:2026-05-21 02:05:04.86528305 +0000 UTC m=+0.486225010,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-115.ec2.internal,}" May 21 02:05:04.877515 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.877485 2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 02:05:04.878116 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.878097 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlft7" May 21 02:05:04.879007 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.878984 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 02:05:04.879540 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879522 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 02:05:04.879667 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879653 2552 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 02:05:04.879667 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879666 2552 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 02:05:04.879781 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879715 2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 02:05:04.879863 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879848 2552 reconstruct.go:97] "Volume reconstruction finished" May 21 02:05:04.879863 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.879863 2552 reconciler.go:26] "Reconciler: start to sync state" May 21 02:05:04.880259 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880242 2552 factory.go:55] Registering systemd factory May 21 02:05:04.880341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880262 2552 factory.go:223] Registration of the systemd container factory successfully May 21 02:05:04.880507 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880483 2552 factory.go:153] Registering CRI-O factory May 21 02:05:04.880507 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880505 2552 factory.go:223] Registration of the crio container factory successfully May 21 02:05:04.880636 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.880510 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:04.880636 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880553 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 02:05:04.880636 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880568 2552 factory.go:103] Registering Raw factory May 21 02:05:04.880636 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.880578 2552 manager.go:1196] Started watching for new ooms in manager May 21 02:05:04.881265 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.881247 2552 manager.go:319] Starting recovery of all containers May 21 02:05:04.882875 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.882852 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlft7" May 21 02:05:04.891770 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.891605 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:04.892481 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.892463 2552 manager.go:324] Recovery completed May 21 02:05:04.893146 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.893129 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-115.ec2.internal\" not found" node="ip-10-0-130-115.ec2.internal" May 21 02:05:04.896743 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.896730 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:04.898578 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.898562 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:04.898649 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.898590 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:04.898649 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.898600 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:04.899042 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.899030 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 02:05:04.899097 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.899041 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 02:05:04.899097 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.899060 2552 state_mem.go:36] "Initialized new in-memory state store" May 21 02:05:04.902717 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.902705 2552 policy_none.go:49] "None policy: Start" May 21 02:05:04.902773 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.902720 2552 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 02:05:04.902773 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.902730 2552 state_mem.go:35] "Initializing new in-memory state store" May 21 02:05:04.947230 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.947206 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.948394 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.948413 2552 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.948429 2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.948435 2552 kubelet.go:2451] "Starting kubelet main sync loop" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.948471 2552 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949011 2552 manager.go:341] "Starting Device Plugin manager" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.949035 2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949044 2552 server.go:85] "Starting device plugin registration server" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949299 2552 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949313 2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949399 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949826 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.949839 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.950700 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:04.950737 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:04.961477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:04.952109 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:05.048847 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.048762 2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal"] May 21 02:05:05.048998 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.048850 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:05.049540 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.049519 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:05.049846 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.049829 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:05.049932 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.049860 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:05.049932 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.049875 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:05.050266 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.050251 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:05.050322 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.050278 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:05.050322 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.050288 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:05.050322 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.050308 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-115.ec2.internal" May 21 02:05:05.052254 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052240 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:05.052387 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052373 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:05.052430 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052400 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:05.052892 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052876 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:05.052892 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052890 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:05.053022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052904 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:05.053022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052911 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:05.053022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052917 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:05.053022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.052921 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:05.055126 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.055110 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.055205 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.055135 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:05.055749 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.055734 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:05.055823 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.055763 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:05.055823 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.055778 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:05.062952 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.062940 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-115.ec2.internal" May 21 02:05:05.063016 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.062959 2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-115.ec2.internal\": node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.076575 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.076553 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-115.ec2.internal\" not found" node="ip-10-0-130-115.ec2.internal" May 21 02:05:05.078879 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.078820 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.080455 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.080440 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-115.ec2.internal\" not found" node="ip-10-0-130-115.ec2.internal" May 21 02:05:05.081105 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.081091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.081151 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.081114 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.081151 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.081131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/993db9f6b73c4a043185a7c9cde0d880-config\") pod \"kube-apiserver-proxy-ip-10-0-130-115.ec2.internal\" (UID: \"993db9f6b73c4a043185a7c9cde0d880\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:05.179030 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.179000 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.182255 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182242 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/993db9f6b73c4a043185a7c9cde0d880-config\") pod \"kube-apiserver-proxy-ip-10-0-130-115.ec2.internal\" (UID: \"993db9f6b73c4a043185a7c9cde0d880\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:05.182319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182262 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.182319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182279 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.182395 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182316 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.182395 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182346 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/993db9f6b73c4a043185a7c9cde0d880-config\") pod \"kube-apiserver-proxy-ip-10-0-130-115.ec2.internal\" (UID: \"993db9f6b73c4a043185a7c9cde0d880\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:05.182395 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.182359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ded299b6258d5d46d23b1c56520723-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal\" (UID: \"b6ded299b6258d5d46d23b1c56520723\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.279450 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.279421 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.380158 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.380091 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.382258 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.382243 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:05.382334 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.382318 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:05.480729 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.480686 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.581152 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.581126 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.681604 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.681532 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.776874 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.776850 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 02:05:05.777393 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.777012 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 02:05:05.777393 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.777031 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 02:05:05.782128 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.782112 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.808189 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.808164 2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:05.880136 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.880113 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 02:05:05.882297 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.882278 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:05.885120 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.885093 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 02:00:04 +0000 UTC" deadline="2027-11-05 17:21:23.250831743 +0000 UTC" May 21 02:05:05.885120 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.885117 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12807h16m17.365717393s" May 21 02:05:05.889365 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.889348 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 02:05:05.907838 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.907818 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rc5sl" May 21 02:05:05.916492 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.916471 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rc5sl" May 21 02:05:05.930437 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:05.930411 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ded299b6258d5d46d23b1c56520723.slice/crio-8c966b537e2893b47453eec77ee2784167cbfd7e854caaf601be8dfd69a17739 WatchSource:0}: Error finding container 8c966b537e2893b47453eec77ee2784167cbfd7e854caaf601be8dfd69a17739: Status 404 returned error can't find the container with id 8c966b537e2893b47453eec77ee2784167cbfd7e854caaf601be8dfd69a17739 May 21 02:05:05.930628 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:05.930614 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993db9f6b73c4a043185a7c9cde0d880.slice/crio-ba868c20f4325cfa4d69985a98160277ec6b4198e8c66dc9295382488f445cc9 WatchSource:0}: Error finding container ba868c20f4325cfa4d69985a98160277ec6b4198e8c66dc9295382488f445cc9: Status 404 returned error can't find the container with id ba868c20f4325cfa4d69985a98160277ec6b4198e8c66dc9295382488f445cc9 May 21 02:05:05.934759 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.934744 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:05:05.951998 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.951939 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" event={"ID":"b6ded299b6258d5d46d23b1c56520723","Type":"ContainerStarted","Data":"8c966b537e2893b47453eec77ee2784167cbfd7e854caaf601be8dfd69a17739"} May 21 02:05:05.952888 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:05.952867 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" event={"ID":"993db9f6b73c4a043185a7c9cde0d880","Type":"ContainerStarted","Data":"ba868c20f4325cfa4d69985a98160277ec6b4198e8c66dc9295382488f445cc9"} May 21 02:05:05.983177 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:05.983151 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:06.083607 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.083572 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:06.184131 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.184058 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:06.284529 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.284504 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-115.ec2.internal\" not found" May 21 02:05:06.374933 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.374905 2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:06.380023 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.379998 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" May 21 02:05:06.388367 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.388344 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 02:05:06.389484 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.389455 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" May 21 02:05:06.399911 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.399889 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 02:05:06.854114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.854090 2552 apiserver.go:52] "Watching apiserver" May 21 02:05:06.862641 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.862615 2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 02:05:06.864079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.864053 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-rk5l7","openshift-multus/network-metrics-daemon-wzdpr","openshift-network-diagnostics/network-check-target-c7g5p","openshift-network-operator/iptables-alerter-qvhs2","openshift-ovn-kubernetes/ovnkube-node-mhf6f","kube-system/konnectivity-agent-48rm2","openshift-cluster-node-tuning-operator/tuned-ghsjm","openshift-dns/node-resolver-gg4lt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal","openshift-multus/multus-7srjx","kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j","openshift-image-registry/node-ca-6dg7x"] May 21 02:05:06.866543 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.866517 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.868641 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.868622 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:06.868729 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.868692 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:06.869183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.869159 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 02:05:06.869183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.869180 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrk4b\"" May 21 02:05:06.869323 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.869153 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 02:05:06.870867 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.870767 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:06.870867 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.870835 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:06.874487 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.874462 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.876834 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.876812 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.877311 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.877290 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cnw45\"" May 21 02:05:06.877449 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.877429 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 02:05:06.877550 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.877480 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 02:05:06.877680 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.877661 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 02:05:06.879057 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.879022 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.879505 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.879434 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 02:05:06.879608 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.879522 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sfwbl\"" May 21 02:05:06.880733 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.880544 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 02:05:06.880733 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.880564 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 02:05:06.880733 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.880620 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 02:05:06.880733 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.880564 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 02:05:06.880958 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.880816 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 02:05:06.881345 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.881291 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 02:05:06.881345 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.881297 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 02:05:06.881345 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.881327 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t9ppd\"" May 21 02:05:06.883655 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.883639 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.884215 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.883983 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:06.885905 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.885888 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 02:05:06.886068 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886044 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7srjx" May 21 02:05:06.886184 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.885894 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 02:05:06.886559 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886539 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 02:05:06.886651 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886378 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 02:05:06.886651 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886515 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5gdm\"" May 21 02:05:06.886758 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.885905 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 02:05:06.886758 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886547 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6p8l9\"" May 21 02:05:06.886758 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.886590 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 02:05:06.887716 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.887686 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 02:05:06.888160 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.888140 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 02:05:06.888406 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.888392 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.889617 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.889599 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t6c9k\"" May 21 02:05:06.890620 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.890589 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 02:05:06.890691 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.890661 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:06.891053 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891034 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bw8b\"" May 21 02:05:06.891144 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891060 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 02:05:06.891144 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891136 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 02:05:06.891316 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-log-socket\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891377 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-sys\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.891377 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891357 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-systemd-units\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891472 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-var-lib-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891472 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-ovn\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891472 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891463 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-node-log\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891577 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891486 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-bin\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891577 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-env-overrides\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891577 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovn-node-metrics-cert\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.891577 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891529 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-lib-modules\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-iptables-alerter-script\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-host-slash\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3136e3e9-5db7-415d-b52c-7dffb1022878-agent-certs\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891682 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-tuned\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891731 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-cnibin\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.891756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891777 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-kubelet\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891811 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-systemd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891836 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-netd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-script-lib\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-host\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891923 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.891948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgfzq\" (UniqueName: \"kubernetes.io/projected/db43fb98-0b07-448c-abd1-52033ba1f2aa-kube-api-access-pgfzq\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-tmp\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892088 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-config\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-var-lib-kubelet\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892204 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892297 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-kubernetes\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d549w\" (UniqueName: \"kubernetes.io/projected/5c9ee481-9c3d-49ac-828d-450ba62b5d20-kube-api-access-d549w\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3136e3e9-5db7-415d-b52c-7dffb1022878-konnectivity-ca\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892384 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-os-release\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892407 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysconfig\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892430 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-systemd\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.892463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892467 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dsj\" (UniqueName: \"kubernetes.io/projected/9648437d-51a0-47bf-a7b7-2e809eb4d6af-kube-api-access-h9dsj\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892495 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-slash\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-netns\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892544 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbcvp\" (UniqueName: \"kubernetes.io/projected/cbe31c48-085f-4d57-9709-eabdf2ae3113-kube-api-access-qbcvp\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwb2s\" (UniqueName: \"kubernetes.io/projected/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-kube-api-access-rwb2s\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892632 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-modprobe-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-conf\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892708 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-run\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-etc-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.892949 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 02:05:06.893071 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.893015 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 02:05:06.893511 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.893227 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptpbx\"" May 21 02:05:06.917739 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.917709 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 02:00:05 +0000 UTC" deadline="2028-03-02 14:39:03.298591474 +0000 UTC" May 21 02:05:06.917739 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.917737 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15636h33m56.380857599s" May 21 02:05:06.980663 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.980606 2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993347 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-systemd-units\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993384 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-var-lib-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993412 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-ovn\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993434 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-node-log\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-systemd-units\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993454 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-env-overrides\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993484 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dkd4\" (UniqueName: \"kubernetes.io/projected/66cf1839-820a-4712-8aa9-6dbdd2b16423-kube-api-access-7dkd4\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-kubelet\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993515 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-var-lib-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-ovn\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993533 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-lib-modules\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993590 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-host-slash\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993617 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3136e3e9-5db7-415d-b52c-7dffb1022878-agent-certs\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993638 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-lib-modules\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993641 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-tuned\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993667 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-socket-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-sys-fs\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993746 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-hostroot\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993771 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-cnibin\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.993793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993798 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993822 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-systemd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993846 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-netd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993872 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-os-release\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-cni-binary-copy\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993923 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993934 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-etc-kubernetes\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.993976 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-env-overrides\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994006 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994032 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-config\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994051 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-node-log\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994060 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994057 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-netd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994088 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-systemd\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-host-slash\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.994526 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994143 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-cnibin\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994172 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.994187 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994200 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-kubernetes\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994225 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d549w\" (UniqueName: \"kubernetes.io/projected/5c9ee481-9c3d-49ac-828d-450ba62b5d20-kube-api-access-d549w\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.994272 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:07.494228856 +0000 UTC m=+3.115170830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994299 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994334 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-multus-daemon-config\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994358 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3136e3e9-5db7-415d-b52c-7dffb1022878-konnectivity-ca\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994379 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysconfig\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994502 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994536 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbcvp\" (UniqueName: \"kubernetes.io/projected/cbe31c48-085f-4d57-9709-eabdf2ae3113-kube-api-access-qbcvp\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994550 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysconfig\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994566 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994576 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-config\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.995269 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-kubernetes\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994595 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-modprobe-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994789 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-modprobe-d\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994831 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-conf\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994847 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-run-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994902 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-etc-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994931 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-serviceca\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994950 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.994958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-socket-dir-parent\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995058 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-etc-openvswitch\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995068 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-sysctl-conf\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-k8s-cni-cncf-io\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995151 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3136e3e9-5db7-415d-b52c-7dffb1022878-konnectivity-ca\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995152 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovn-node-metrics-cert\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995242 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-registration-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.996076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995302 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-device-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995317 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-bin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995399 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-multus\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-multus-certs\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2ltc\" (UniqueName: \"kubernetes.io/projected/08441043-1984-4640-828c-c907920d4114-kube-api-access-b2ltc\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995532 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-iptables-alerter-script\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995559 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-script-lib\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995867 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b35b488-aed7-4e2b-b946-008b29b38c79-hosts-file\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995902 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-kubelet\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-cnibin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.995999 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-host\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-host\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996041 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996075 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996096 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgfzq\" (UniqueName: \"kubernetes.io/projected/db43fb98-0b07-448c-abd1-52033ba1f2aa-kube-api-access-pgfzq\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996134 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-tmp\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.996822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996178 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7vcn\" (UniqueName: \"kubernetes.io/projected/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-kube-api-access-c7vcn\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b35b488-aed7-4e2b-b946-008b29b38c79-tmp-dir\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-netns\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996268 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-kubelet\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996274 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-var-lib-kubelet\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996341 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-host\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996371 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996399 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-os-release\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-var-lib-kubelet\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996423 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-systemd\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996448 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dsj\" (UniqueName: \"kubernetes.io/projected/9648437d-51a0-47bf-a7b7-2e809eb4d6af-kube-api-access-h9dsj\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996471 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-slash\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-slash\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996505 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-netns\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-log-socket\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996562 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-os-release\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.997576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm28p\" (UniqueName: \"kubernetes.io/projected/8b35b488-aed7-4e2b-b946-008b29b38c79-kube-api-access-dm28p\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996606 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-systemd\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996652 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-log-socket\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996688 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-run-netns\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db43fb98-0b07-448c-abd1-52033ba1f2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996823 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db43fb98-0b07-448c-abd1-52033ba1f2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996910 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-iptables-alerter-script\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996959 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-bin\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovnkube-script-lib\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.996627 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c9ee481-9c3d-49ac-828d-450ba62b5d20-host-cni-bin\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997298 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwb2s\" (UniqueName: \"kubernetes.io/projected/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-kube-api-access-rwb2s\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997323 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-run\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997350 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-system-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-conf-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997401 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-sys\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997485 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-etc-tuned\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-sys\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997598 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9648437d-51a0-47bf-a7b7-2e809eb4d6af-run\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.998194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c9ee481-9c3d-49ac-828d-450ba62b5d20-ovn-node-metrics-cert\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:06.998796 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.997655 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3136e3e9-5db7-415d-b52c-7dffb1022878-agent-certs\") pod \"konnectivity-agent-48rm2\" (UID: \"3136e3e9-5db7-415d-b52c-7dffb1022878\") " pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:06.999252 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:06.999226 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9648437d-51a0-47bf-a7b7-2e809eb4d6af-tmp\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:06.999878 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.999840 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:06.999878 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.999862 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:06.999878 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.999873 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:07.000040 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:06.999925 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:07.499912541 +0000 UTC m=+3.120854507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:07.005672 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.005649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbcvp\" (UniqueName: \"kubernetes.io/projected/cbe31c48-085f-4d57-9709-eabdf2ae3113-kube-api-access-qbcvp\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:07.006418 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.006400 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d549w\" (UniqueName: \"kubernetes.io/projected/5c9ee481-9c3d-49ac-828d-450ba62b5d20-kube-api-access-d549w\") pod \"ovnkube-node-mhf6f\" (UID: \"5c9ee481-9c3d-49ac-828d-450ba62b5d20\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:07.006978 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.006942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dsj\" (UniqueName: \"kubernetes.io/projected/9648437d-51a0-47bf-a7b7-2e809eb4d6af-kube-api-access-h9dsj\") pod \"tuned-ghsjm\" (UID: \"9648437d-51a0-47bf-a7b7-2e809eb4d6af\") " pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:07.007094 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.007075 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwb2s\" (UniqueName: \"kubernetes.io/projected/e4ef37ec-7422-4e99-b6c6-cc761dd7706d-kube-api-access-rwb2s\") pod \"iptables-alerter-qvhs2\" (UID: \"e4ef37ec-7422-4e99-b6c6-cc761dd7706d\") " pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:07.007255 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.007232 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgfzq\" (UniqueName: \"kubernetes.io/projected/db43fb98-0b07-448c-abd1-52033ba1f2aa-kube-api-access-pgfzq\") pod \"multus-additional-cni-plugins-rk5l7\" (UID: \"db43fb98-0b07-448c-abd1-52033ba1f2aa\") " pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:07.070761 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.070740 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:07.097903 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.097882 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7vcn\" (UniqueName: \"kubernetes.io/projected/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-kube-api-access-c7vcn\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.098046 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.097915 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b35b488-aed7-4e2b-b946-008b29b38c79-tmp-dir\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.098046 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.097940 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-netns\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098046 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098007 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-netns\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098055 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dm28p\" (UniqueName: \"kubernetes.io/projected/8b35b488-aed7-4e2b-b946-008b29b38c79-kube-api-access-dm28p\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098086 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-system-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098102 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-conf-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098121 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dkd4\" (UniqueName: \"kubernetes.io/projected/66cf1839-820a-4712-8aa9-6dbdd2b16423-kube-api-access-7dkd4\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098140 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-kubelet\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098172 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-system-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-kubelet\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098198 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-conf-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b35b488-aed7-4e2b-b946-008b29b38c79-tmp-dir\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098251 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-socket-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098279 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-sys-fs\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098303 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-hostroot\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098330 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-os-release\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098353 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-cni-binary-copy\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098360 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-hostroot\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098375 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-etc-kubernetes\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-sys-fs\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098382 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-socket-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098411 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-etc-kubernetes\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098432 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-os-release\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.098451 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098434 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098487 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098493 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098521 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-multus-daemon-config\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098556 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-serviceca\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098576 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098579 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-socket-dir-parent\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098611 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-k8s-cni-cncf-io\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098621 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-socket-dir-parent\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098638 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-registration-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098664 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-device-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098676 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-k8s-cni-cncf-io\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098688 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-bin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098713 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-multus\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098738 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-multus-certs\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098764 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ltc\" (UniqueName: \"kubernetes.io/projected/08441043-1984-4640-828c-c907920d4114-kube-api-access-b2ltc\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098792 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b35b488-aed7-4e2b-b946-008b29b38c79-hosts-file\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098817 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-cnibin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099183 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098842 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-host\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-multus\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-cni-binary-copy\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098907 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-host\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098939 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-run-multus-certs\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.098989 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-registration-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099014 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-multus-cni-dir\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099027 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-serviceca\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099038 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66cf1839-820a-4712-8aa9-6dbdd2b16423-device-dir\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b35b488-aed7-4e2b-b946-008b29b38c79-hosts-file\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099079 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-host-var-lib-cni-bin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099086 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08441043-1984-4640-828c-c907920d4114-cnibin\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.099882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.099187 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08441043-1984-4640-828c-c907920d4114-multus-daemon-config\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.105921 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.105902 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ltc\" (UniqueName: \"kubernetes.io/projected/08441043-1984-4640-828c-c907920d4114-kube-api-access-b2ltc\") pod \"multus-7srjx\" (UID: \"08441043-1984-4640-828c-c907920d4114\") " pod="openshift-multus/multus-7srjx" May 21 02:05:07.106144 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.106126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dkd4\" (UniqueName: \"kubernetes.io/projected/66cf1839-820a-4712-8aa9-6dbdd2b16423-kube-api-access-7dkd4\") pod \"aws-ebs-csi-driver-node-j2b9j\" (UID: \"66cf1839-820a-4712-8aa9-6dbdd2b16423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.106238 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.106213 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm28p\" (UniqueName: \"kubernetes.io/projected/8b35b488-aed7-4e2b-b946-008b29b38c79-kube-api-access-dm28p\") pod \"node-resolver-gg4lt\" (UID: \"8b35b488-aed7-4e2b-b946-008b29b38c79\") " pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.106667 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.106651 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7vcn\" (UniqueName: \"kubernetes.io/projected/5be69ed9-72da-481e-b8b4-a83fbb16cb4a-kube-api-access-c7vcn\") pod \"node-ca-6dg7x\" (UID: \"5be69ed9-72da-481e-b8b4-a83fbb16cb4a\") " pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.162265 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.162240 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:07.177362 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.177340 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" May 21 02:05:07.187194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.187170 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvhs2" May 21 02:05:07.196734 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.196711 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:07.200768 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.200747 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:07.206285 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.206268 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" May 21 02:05:07.212813 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.212793 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gg4lt" May 21 02:05:07.218375 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.218358 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7srjx" May 21 02:05:07.227897 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.227881 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" May 21 02:05:07.232362 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.232328 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6dg7x" May 21 02:05:07.502429 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.502357 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:07.502429 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.502397 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502505 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502522 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502543 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502556 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:08.502540989 +0000 UTC m=+4.123482936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502557 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:07.502625 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:07.502602 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:08.502593033 +0000 UTC m=+4.123534985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:07.617491 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.617463 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb43fb98_0b07_448c_abd1_52033ba1f2aa.slice/crio-1b71aa5043557a4ec4c76da6569612989f885b35c546b6d201e50518566c9782 WatchSource:0}: Error finding container 1b71aa5043557a4ec4c76da6569612989f885b35c546b6d201e50518566c9782: Status 404 returned error can't find the container with id 1b71aa5043557a4ec4c76da6569612989f885b35c546b6d201e50518566c9782 May 21 02:05:07.619109 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.619087 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9ee481_9c3d_49ac_828d_450ba62b5d20.slice/crio-81585e8db2cf073b25ab8dc6222afc926680c12112c13ada2d0a96762c0b047b WatchSource:0}: Error finding container 81585e8db2cf073b25ab8dc6222afc926680c12112c13ada2d0a96762c0b047b: Status 404 returned error can't find the container with id 81585e8db2cf073b25ab8dc6222afc926680c12112c13ada2d0a96762c0b047b May 21 02:05:07.621978 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.621943 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cf1839_820a_4712_8aa9_6dbdd2b16423.slice/crio-5455fef549012c013971ff4ed22de66ad097a97cff3de2213a0ba0801f3ab2c3 WatchSource:0}: Error finding container 5455fef549012c013971ff4ed22de66ad097a97cff3de2213a0ba0801f3ab2c3: Status 404 returned error can't find the container with id 5455fef549012c013971ff4ed22de66ad097a97cff3de2213a0ba0801f3ab2c3 May 21 02:05:07.622953 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.622931 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ef37ec_7422_4e99_b6c6_cc761dd7706d.slice/crio-bf7ad704d52fde5e3544c317cc2b682384a145bddd99c01884035185eb3ec713 WatchSource:0}: Error finding container bf7ad704d52fde5e3544c317cc2b682384a145bddd99c01884035185eb3ec713: Status 404 returned error can't find the container with id bf7ad704d52fde5e3544c317cc2b682384a145bddd99c01884035185eb3ec713 May 21 02:05:07.623677 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.623632 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08441043_1984_4640_828c_c907920d4114.slice/crio-52c096f19e2e38bfae26e13d418f2a25eba7c55f41f31b7f96e3d4a57c9d6839 WatchSource:0}: Error finding container 52c096f19e2e38bfae26e13d418f2a25eba7c55f41f31b7f96e3d4a57c9d6839: Status 404 returned error can't find the container with id 52c096f19e2e38bfae26e13d418f2a25eba7c55f41f31b7f96e3d4a57c9d6839 May 21 02:05:07.625254 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.625171 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b35b488_aed7_4e2b_b946_008b29b38c79.slice/crio-5c22d2fe1a6bc6dffdc9328c59c22b655d366472fe2ac6c17a35f69392f1027d WatchSource:0}: Error finding container 5c22d2fe1a6bc6dffdc9328c59c22b655d366472fe2ac6c17a35f69392f1027d: Status 404 returned error can't find the container with id 5c22d2fe1a6bc6dffdc9328c59c22b655d366472fe2ac6c17a35f69392f1027d May 21 02:05:07.626227 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.625932 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be69ed9_72da_481e_b8b4_a83fbb16cb4a.slice/crio-a0cf4b87d7f16fb1a7e351dcae2bd1d65a0f481cd67a6a141f4a1c46b93167f5 WatchSource:0}: Error finding container a0cf4b87d7f16fb1a7e351dcae2bd1d65a0f481cd67a6a141f4a1c46b93167f5: Status 404 returned error can't find the container with id a0cf4b87d7f16fb1a7e351dcae2bd1d65a0f481cd67a6a141f4a1c46b93167f5 May 21 02:05:07.626669 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.626650 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9648437d_51a0_47bf_a7b7_2e809eb4d6af.slice/crio-1ad932492700c9463bd51f80c23f2221be16067d5cb5b0fd5fdbec5754ac6f62 WatchSource:0}: Error finding container 1ad932492700c9463bd51f80c23f2221be16067d5cb5b0fd5fdbec5754ac6f62: Status 404 returned error can't find the container with id 1ad932492700c9463bd51f80c23f2221be16067d5cb5b0fd5fdbec5754ac6f62 May 21 02:05:07.627948 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:07.627866 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3136e3e9_5db7_415d_b52c_7dffb1022878.slice/crio-bc3b0016e5abc122f37337abe88bb756067124134ebacb7a61d000ca90f8209f WatchSource:0}: Error finding container bc3b0016e5abc122f37337abe88bb756067124134ebacb7a61d000ca90f8209f: Status 404 returned error can't find the container with id bc3b0016e5abc122f37337abe88bb756067124134ebacb7a61d000ca90f8209f May 21 02:05:07.918015 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.917848 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 02:00:05 +0000 UTC" deadline="2028-02-23 12:24:05.2140221 +0000 UTC" May 21 02:05:07.918015 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.918005 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15442h18m57.296021617s" May 21 02:05:07.956021 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.955991 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7srjx" event={"ID":"08441043-1984-4640-828c-c907920d4114","Type":"ContainerStarted","Data":"52c096f19e2e38bfae26e13d418f2a25eba7c55f41f31b7f96e3d4a57c9d6839"} May 21 02:05:07.956875 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.956853 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" event={"ID":"66cf1839-820a-4712-8aa9-6dbdd2b16423","Type":"ContainerStarted","Data":"5455fef549012c013971ff4ed22de66ad097a97cff3de2213a0ba0801f3ab2c3"} May 21 02:05:07.957692 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.957672 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6dg7x" event={"ID":"5be69ed9-72da-481e-b8b4-a83fbb16cb4a","Type":"ContainerStarted","Data":"a0cf4b87d7f16fb1a7e351dcae2bd1d65a0f481cd67a6a141f4a1c46b93167f5"} May 21 02:05:07.958453 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.958438 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gg4lt" event={"ID":"8b35b488-aed7-4e2b-b946-008b29b38c79","Type":"ContainerStarted","Data":"5c22d2fe1a6bc6dffdc9328c59c22b655d366472fe2ac6c17a35f69392f1027d"} May 21 02:05:07.959178 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.959160 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvhs2" event={"ID":"e4ef37ec-7422-4e99-b6c6-cc761dd7706d","Type":"ContainerStarted","Data":"bf7ad704d52fde5e3544c317cc2b682384a145bddd99c01884035185eb3ec713"} May 21 02:05:07.959879 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.959861 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"81585e8db2cf073b25ab8dc6222afc926680c12112c13ada2d0a96762c0b047b"} May 21 02:05:07.960669 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.960654 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerStarted","Data":"1b71aa5043557a4ec4c76da6569612989f885b35c546b6d201e50518566c9782"} May 21 02:05:07.962034 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.962012 2552 generic.go:358] "Generic (PLEG): container finished" podID="b6ded299b6258d5d46d23b1c56520723" containerID="e4cc80e6263885cbc9d4aa5786513b144bfa9a691de843a3aafb39eabe4cf01d" exitCode=0 May 21 02:05:07.962113 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.962035 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" event={"ID":"b6ded299b6258d5d46d23b1c56520723","Type":"ContainerDied","Data":"e4cc80e6263885cbc9d4aa5786513b144bfa9a691de843a3aafb39eabe4cf01d"} May 21 02:05:07.963206 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.963187 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" event={"ID":"993db9f6b73c4a043185a7c9cde0d880","Type":"ContainerStarted","Data":"9f9e4bd7333e813c96a35b6dc1b107616c437d345cab6eb08fed5bef013b2d44"} May 21 02:05:07.964200 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.964180 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-48rm2" event={"ID":"3136e3e9-5db7-415d-b52c-7dffb1022878","Type":"ContainerStarted","Data":"bc3b0016e5abc122f37337abe88bb756067124134ebacb7a61d000ca90f8209f"} May 21 02:05:07.965891 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.965874 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" event={"ID":"9648437d-51a0-47bf-a7b7-2e809eb4d6af","Type":"ContainerStarted","Data":"1ad932492700c9463bd51f80c23f2221be16067d5cb5b0fd5fdbec5754ac6f62"} May 21 02:05:07.986504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:07.986448 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-115.ec2.internal" podStartSLOduration=1.986431567 podStartE2EDuration="1.986431567s" podCreationTimestamp="2026-05-21 02:05:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:05:07.985886335 +0000 UTC m=+3.606828306" watchObservedRunningTime="2026-05-21 02:05:07.986431567 +0000 UTC m=+3.607373538" May 21 02:05:08.510128 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:08.510084 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:08.510314 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:08.510140 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:08.510314 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510277 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:08.510428 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510354 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:10.510320966 +0000 UTC m=+6.131262929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:08.510868 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510842 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:08.510988 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510878 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:08.510988 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510894 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:08.510988 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.510978 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:10.510946965 +0000 UTC m=+6.131888917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:08.951677 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:08.951484 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:08.951677 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.951616 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:08.952190 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:08.952049 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:08.952244 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:08.952188 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:08.989573 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:08.989526 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" event={"ID":"b6ded299b6258d5d46d23b1c56520723","Type":"ContainerStarted","Data":"0e13f344afc313105686a02f658404bb31fccba96ccae0ee2bb7e8aaacdac2c7"} May 21 02:05:09.002876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:09.002826 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-115.ec2.internal" podStartSLOduration=3.002812042 podStartE2EDuration="3.002812042s" podCreationTimestamp="2026-05-21 02:05:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:05:09.002022818 +0000 UTC m=+4.622964788" watchObservedRunningTime="2026-05-21 02:05:09.002812042 +0000 UTC m=+4.623754014" May 21 02:05:10.526264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:10.526170 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:10.526264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:10.526231 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:10.526745 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526367 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:10.526745 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526434 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:14.526413575 +0000 UTC m=+10.147355568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:10.526865 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526834 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:10.526865 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526851 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:10.526865 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526864 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:10.527026 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.526910 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:14.526892822 +0000 UTC m=+10.147834775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:10.949669 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:10.949587 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:10.949828 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.949716 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:10.949828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:10.949791 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:10.949932 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:10.949899 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:12.953114 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:12.953084 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:12.953539 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:12.953084 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:12.953539 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:12.953219 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:12.953539 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:12.953303 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:14.558488 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:14.558450 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:14.558510 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558634 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558692 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:22.558673877 +0000 UTC m=+18.179615839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558634 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558733 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558749 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:14.558922 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.558803 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:22.55878648 +0000 UTC m=+18.179728433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:14.951063 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:14.949621 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:14.951063 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.949743 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:14.951063 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:14.950825 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:14.951063 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:14.950933 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:16.949271 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:16.949239 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:16.949782 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:16.949239 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:16.949782 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:16.949336 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:16.949782 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:16.949449 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:18.948680 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:18.948647 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:18.949106 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:18.948647 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:18.949106 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:18.948766 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:18.949106 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:18.948872 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:20.948917 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:20.948887 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:20.949408 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:20.949047 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:20.949408 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:20.949071 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:20.949408 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:20.949174 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:22.622827 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:22.622788 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:22.622838 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.622948 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.622953 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.622989 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.623004 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.623019 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.623001357 +0000 UTC m=+34.243943309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:22.623341 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.623051 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.62303462 +0000 UTC m=+34.243976569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:22.949295 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:22.949220 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:22.949445 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.949321 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:22.949445 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:22.949396 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:22.949527 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:22.949491 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:24.949671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:24.949639 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:24.950142 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:24.949730 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:24.950142 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:24.949772 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:24.950142 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:24.949834 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:26.038286 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:26.037502 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerStarted","Data":"6a4a4cd3c46eebcddcaf77ee644fe925e7c429ea8681e56127e5b7bf7808fd4a"} May 21 02:05:26.039466 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:26.039371 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6dg7x" event={"ID":"5be69ed9-72da-481e-b8b4-a83fbb16cb4a","Type":"ContainerStarted","Data":"3ac533d82adab1e7838c0601da4b14ecb0a7ec2640acce4ffba445bc06bc0a27"} May 21 02:05:26.063871 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:26.063833 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6dg7x" podStartSLOduration=6.761784312 podStartE2EDuration="21.063819345s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.627821107 +0000 UTC m=+3.248763054" lastFinishedPulling="2026-05-21 02:05:21.929856136 +0000 UTC m=+17.550798087" observedRunningTime="2026-05-21 02:05:26.063802988 +0000 UTC m=+21.684744948" watchObservedRunningTime="2026-05-21 02:05:26.063819345 +0000 UTC m=+21.684761339" May 21 02:05:26.948862 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:26.948685 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:26.949042 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:26.948722 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:26.949909 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:26.949353 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:26.950047 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:26.949905 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:27.042638 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.042333 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" event={"ID":"9648437d-51a0-47bf-a7b7-2e809eb4d6af","Type":"ContainerStarted","Data":"8e67e6f406de4e111c54ae1b2bb5594cb71d3812be7233ef52fb87b69c9d5008"} May 21 02:05:27.044481 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.044459 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7srjx" event={"ID":"08441043-1984-4640-828c-c907920d4114","Type":"ContainerStarted","Data":"3d4b41e882624226b96d2f0b3fcef17f71f3ae8bf2e952a61ccac5b842b965d1"} May 21 02:05:27.045662 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.045632 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" event={"ID":"66cf1839-820a-4712-8aa9-6dbdd2b16423","Type":"ContainerStarted","Data":"859e955894f54fbf7e47e512169e44b8b70e323c035272325a38ac5f1335afb7"} May 21 02:05:27.046822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.046794 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gg4lt" event={"ID":"8b35b488-aed7-4e2b-b946-008b29b38c79","Type":"ContainerStarted","Data":"67a16875a983fa9548ef7aab06e7d1d89122eb31bb01cf70909587f5616b2108"} May 21 02:05:27.048949 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.048934 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:05:27.049232 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049215 2552 generic.go:358] "Generic (PLEG): container finished" podID="5c9ee481-9c3d-49ac-828d-450ba62b5d20" containerID="41378398bbfb2bb147cc23af9caa7d30d3d45a2c5ce59b95ddb3c4f3d36429b9" exitCode=1 May 21 02:05:27.049299 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049278 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"86f8f46e5a2cc8c5513ec00df4be0c6ae18e057cf1af450859b5c217a2d2b36b"} May 21 02:05:27.049347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049302 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"e39630292ed609a043e861595f0dfa1d93102d6a7d56f54c11a6d7a5802ece69"} May 21 02:05:27.049347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049315 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"da91a842794662fcff5e79dd7dcd85999f182132be7343559cbef90089f64bf4"} May 21 02:05:27.049347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049324 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"530545864c2db98651ed70ad6deca8b1bcec58597bb09028979c39962dcd0452"} May 21 02:05:27.049347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049336 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerDied","Data":"41378398bbfb2bb147cc23af9caa7d30d3d45a2c5ce59b95ddb3c4f3d36429b9"} May 21 02:05:27.049524 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.049349 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"33e6c9b01d541c89d2ee907f8f4447a3b7540fd657c14ddd5f37b866df0ef330"} May 21 02:05:27.050350 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.050334 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="6a4a4cd3c46eebcddcaf77ee644fe925e7c429ea8681e56127e5b7bf7808fd4a" exitCode=0 May 21 02:05:27.050427 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.050387 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"6a4a4cd3c46eebcddcaf77ee644fe925e7c429ea8681e56127e5b7bf7808fd4a"} May 21 02:05:27.051566 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.051493 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-48rm2" event={"ID":"3136e3e9-5db7-415d-b52c-7dffb1022878","Type":"ContainerStarted","Data":"c8503d3665cc0ae9eebee82c3a40da15865474d7548b1be0d6bb5deda46e751b"} May 21 02:05:27.067847 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.067812 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ghsjm" podStartSLOduration=3.852458873 podStartE2EDuration="22.067802865s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.628765495 +0000 UTC m=+3.249707445" lastFinishedPulling="2026-05-21 02:05:25.844109476 +0000 UTC m=+21.465051437" observedRunningTime="2026-05-21 02:05:27.067368627 +0000 UTC m=+22.688310597" watchObservedRunningTime="2026-05-21 02:05:27.067802865 +0000 UTC m=+22.688744828" May 21 02:05:27.108687 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.108650 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7srjx" podStartSLOduration=3.522129401 podStartE2EDuration="22.108640155s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.62559241 +0000 UTC m=+3.246534362" lastFinishedPulling="2026-05-21 02:05:26.212103154 +0000 UTC m=+21.833045116" observedRunningTime="2026-05-21 02:05:27.108097409 +0000 UTC m=+22.729039379" watchObservedRunningTime="2026-05-21 02:05:27.108640155 +0000 UTC m=+22.729582124" May 21 02:05:27.126116 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.126060 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-48rm2" podStartSLOduration=3.94166285 podStartE2EDuration="22.126050577s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.629751435 +0000 UTC m=+3.250693396" lastFinishedPulling="2026-05-21 02:05:25.814139174 +0000 UTC m=+21.435081123" observedRunningTime="2026-05-21 02:05:27.125804424 +0000 UTC m=+22.746746405" watchObservedRunningTime="2026-05-21 02:05:27.126050577 +0000 UTC m=+22.746992545" May 21 02:05:27.143684 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.143648 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gg4lt" podStartSLOduration=3.9569165809999998 podStartE2EDuration="22.143638535s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.627388777 +0000 UTC m=+3.248330727" lastFinishedPulling="2026-05-21 02:05:25.814110724 +0000 UTC m=+21.435052681" observedRunningTime="2026-05-21 02:05:27.143386746 +0000 UTC m=+22.764328726" watchObservedRunningTime="2026-05-21 02:05:27.143638535 +0000 UTC m=+22.764580504" May 21 02:05:27.248299 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.248274 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 02:05:27.960476 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.960372 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T02:05:27.248295973Z","UUID":"3c1e0375-a6b7-45c1-a4db-c04fd0f42567","Handler":null,"Name":"","Endpoint":""} May 21 02:05:27.962302 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.962114 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 02:05:27.962302 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:27.962307 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 02:05:28.055709 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:28.055661 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" event={"ID":"66cf1839-820a-4712-8aa9-6dbdd2b16423","Type":"ContainerStarted","Data":"4e9297dfa65a4debb93c2ad6dd66be74b02a9007f50c092f73802a85b90df961"} May 21 02:05:28.057301 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:28.057269 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvhs2" event={"ID":"e4ef37ec-7422-4e99-b6c6-cc761dd7706d","Type":"ContainerStarted","Data":"838466a19aed4604db6514cdc7c7f443520a9dcfb2284b820dc63799a304bd69"} May 21 02:05:28.071591 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:28.071547 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qvhs2" podStartSLOduration=4.851285805 podStartE2EDuration="23.07153169s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.624862976 +0000 UTC m=+3.245804931" lastFinishedPulling="2026-05-21 02:05:25.84510886 +0000 UTC m=+21.466050816" observedRunningTime="2026-05-21 02:05:28.071424258 +0000 UTC m=+23.692366228" watchObservedRunningTime="2026-05-21 02:05:28.07153169 +0000 UTC m=+23.692473660" May 21 02:05:28.949700 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:28.949669 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:28.949883 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:28.949668 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:28.949883 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:28.949784 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:28.949883 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:28.949821 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:29.061009 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:29.060975 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" event={"ID":"66cf1839-820a-4712-8aa9-6dbdd2b16423","Type":"ContainerStarted","Data":"89d0524938106f977ffc9af41d06aedce1e4f1c85d61f58e424be5de69b7766b"} May 21 02:05:29.063924 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:29.063902 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:05:29.064243 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:29.064219 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"53599bcb78f07b970009df3f2c5b4d3a00c68b2045b880c96278ee0a792d2b4e"} May 21 02:05:29.079778 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:29.079730 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2b9j" podStartSLOduration=3.388137446 podStartE2EDuration="24.079716162s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.623705469 +0000 UTC m=+3.244647425" lastFinishedPulling="2026-05-21 02:05:28.315284191 +0000 UTC m=+23.936226141" observedRunningTime="2026-05-21 02:05:29.078979538 +0000 UTC m=+24.699921499" watchObservedRunningTime="2026-05-21 02:05:29.079716162 +0000 UTC m=+24.700658131" May 21 02:05:30.949295 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:30.949157 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:30.949720 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:30.949211 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:30.949720 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:30.949404 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:30.949720 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:30.949439 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:31.070009 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.069933 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerStarted","Data":"6779f546378c4567727e6a1b2962ff7f24587836f4696248c2e0890120eb0391"} May 21 02:05:31.073158 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073140 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:05:31.073519 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073494 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"524520b4a16435309eaca8b14a802607cd7f3e8c19066ad077052934f3ff71f9"} May 21 02:05:31.073859 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073836 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:31.073915 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073877 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:31.073915 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073892 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:31.074025 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.073935 2552 scope.go:117] "RemoveContainer" containerID="41378398bbfb2bb147cc23af9caa7d30d3d45a2c5ce59b95ddb3c4f3d36429b9" May 21 02:05:31.093765 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.093743 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:31.096223 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:31.096204 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:05:32.050719 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.050690 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:32.051239 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.051224 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:32.078616 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.078590 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:05:32.078919 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.078897 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" event={"ID":"5c9ee481-9c3d-49ac-828d-450ba62b5d20","Type":"ContainerStarted","Data":"3216f76d1886c171a4b0a4c79bcdc12d09ee2ff50f94dd0d4aee604b8e789122"} May 21 02:05:32.080270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.080248 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="6779f546378c4567727e6a1b2962ff7f24587836f4696248c2e0890120eb0391" exitCode=0 May 21 02:05:32.080336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.080309 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"6779f546378c4567727e6a1b2962ff7f24587836f4696248c2e0890120eb0391"} May 21 02:05:32.102721 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.102677 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" podStartSLOduration=8.868357544 podStartE2EDuration="27.102667243s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.621367132 +0000 UTC m=+3.242309085" lastFinishedPulling="2026-05-21 02:05:25.855676833 +0000 UTC m=+21.476618784" observedRunningTime="2026-05-21 02:05:32.100954706 +0000 UTC m=+27.721896675" watchObservedRunningTime="2026-05-21 02:05:32.102667243 +0000 UTC m=+27.723609212" May 21 02:05:32.897866 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.897837 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzdpr"] May 21 02:05:32.898012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.898001 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:32.898135 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:32.898112 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:32.900819 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.900526 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7g5p"] May 21 02:05:32.900819 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:32.900641 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:32.900819 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:32.900726 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:33.084179 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:33.084145 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="86353246b28d4131911769e03f42f65ac199a9f1c0fef7ed155446aeed2685ba" exitCode=0 May 21 02:05:33.084474 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:33.084225 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"86353246b28d4131911769e03f42f65ac199a9f1c0fef7ed155446aeed2685ba"} May 21 02:05:34.088531 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:34.088498 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="0bc76182170899ca7e26c7a1ac81cfaa1b8714f88de7c859779ed9c9d0761f21" exitCode=0 May 21 02:05:34.088839 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:34.088563 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"0bc76182170899ca7e26c7a1ac81cfaa1b8714f88de7c859779ed9c9d0761f21"} May 21 02:05:34.954287 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:34.954051 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:34.954424 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:34.954118 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:34.954424 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:34.954390 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:34.954533 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:34.954430 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:35.669682 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:35.669646 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:35.670342 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:35.669819 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 02:05:35.670342 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:35.670257 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-48rm2" May 21 02:05:36.949156 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:36.949119 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:36.949558 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:36.949243 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7g5p" podUID="fbc00dba-6714-42fd-813c-e207633c6cf8" May 21 02:05:36.949558 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:36.949332 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:36.949558 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:36.949455 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:05:37.638094 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.638067 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-115.ec2.internal" event="NodeReady" May 21 02:05:37.638222 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.638209 2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 02:05:37.669112 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.669085 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh"] May 21 02:05:37.746111 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.746073 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf"] May 21 02:05:37.746248 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.746212 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.748912 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.748889 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 02:05:37.749138 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.749028 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 02:05:37.749138 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.749104 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 02:05:37.749138 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.749104 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6jqn2\"" May 21 02:05:37.749342 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.749201 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 02:05:37.753288 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.753260 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bb74756c6-jjn62"] May 21 02:05:37.753484 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.753464 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.756029 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.755592 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq"] May 21 02:05:37.756029 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.755718 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.756029 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.755863 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 02:05:37.756235 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.756217 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 02:05:37.756295 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.756238 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wsxkz\"" May 21 02:05:37.758116 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.758097 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 02:05:37.758356 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.758338 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 02:05:37.758510 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.758492 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 02:05:37.758635 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.758615 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hg56n\"" May 21 02:05:37.764368 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.764348 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 02:05:37.768994 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.768903 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj"] May 21 02:05:37.781865 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.781849 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.784364 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.784339 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 02:05:37.784453 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.784377 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 02:05:37.784513 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.784505 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 02:05:37.784583 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.784568 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 02:05:37.807768 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.807749 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh"] May 21 02:05:37.807877 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.807776 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf"] May 21 02:05:37.807877 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.807798 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq"] May 21 02:05:37.807877 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.807814 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jkdrp"] May 21 02:05:37.808064 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.807902 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:37.810240 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.810223 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 02:05:37.828642 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.828598 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8h7nk"] May 21 02:05:37.828750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.828734 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:37.831236 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.831210 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 02:05:37.831329 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.831237 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x7bwd\"" May 21 02:05:37.831329 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.831281 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 02:05:37.831329 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.831238 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 02:05:37.842847 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.842828 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj"] May 21 02:05:37.842942 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.842854 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb74756c6-jjn62"] May 21 02:05:37.842942 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.842867 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkdrp"] May 21 02:05:37.842942 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.842877 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8h7nk"] May 21 02:05:37.843088 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.843071 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8h7nk" May 21 02:05:37.844058 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844039 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844069 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2btb\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844187 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e16c40a-d01e-44c3-bea4-8aaae3dce764-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844229 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c829d797-891b-4962-9c7e-5ba537adb281-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844263 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fddrg\" (UniqueName: \"kubernetes.io/projected/3e16c40a-d01e-44c3-bea4-8aaae3dce764-kube-api-access-fddrg\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.844336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.844292 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.845367 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.845348 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 02:05:37.845458 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.845384 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 02:05:37.845744 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.845726 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2mvhm\"" May 21 02:05:37.944842 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944818 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944851 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2btb\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944885 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.945008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.945008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944939 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b93d08-be2a-41d0-9e3c-96f0f64e1906-tmp\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:37.945008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.944977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phsvg\" (UniqueName: \"kubernetes.io/projected/49b93d08-be2a-41d0-9e3c-96f0f64e1906-kube-api-access-phsvg\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945014 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945040 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945065 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvml\" (UniqueName: \"kubernetes.io/projected/27ee78eb-2bd4-446f-8ee3-fd763af995e8-kube-api-access-bdvml\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945193 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945239 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e16c40a-d01e-44c3-bea4-8aaae3dce764-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.945270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945314 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:37.945339 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:37.945409 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.445390725 +0000 UTC m=+34.066332672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945341 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945597 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.945617 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945611 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc95l\" (UniqueName: \"kubernetes.io/projected/373b7aa7-5e36-48c8-b936-b75b188ca2f0-kube-api-access-rc95l\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945660 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c829d797-891b-4962-9c7e-5ba537adb281-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945695 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njtpq\" (UniqueName: \"kubernetes.io/projected/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-kube-api-access-njtpq\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945728 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b93d08-be2a-41d0-9e3c-96f0f64e1906-klusterlet-config\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945828 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fddrg\" (UniqueName: \"kubernetes.io/projected/3e16c40a-d01e-44c3-bea4-8aaae3dce764-kube-api-access-fddrg\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.945876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945856 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945882 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945926 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945946 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-config-volume\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.945988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-tmp-dir\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:37.946125 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:37.946138 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:37.946193 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:37.946194 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.446178514 +0000 UTC m=+34.067120472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:37.946516 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.946334 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c829d797-891b-4962-9c7e-5ba537adb281-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:37.946516 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.946348 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.950110 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.950087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.950110 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.950096 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.950604 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.950164 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e16c40a-d01e-44c3-bea4-8aaae3dce764-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:37.959106 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.959040 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.959750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.959724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2btb\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:37.959750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:37.959729 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fddrg\" (UniqueName: \"kubernetes.io/projected/3e16c40a-d01e-44c3-bea4-8aaae3dce764-kube-api-access-fddrg\") pod \"managed-serviceaccount-addon-agent-6bbb66c944-9gnlh\" (UID: \"3e16c40a-d01e-44c3-bea4-8aaae3dce764\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:38.047192 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047159 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047192 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047371 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047211 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b93d08-be2a-41d0-9e3c-96f0f64e1906-tmp\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.047371 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047234 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phsvg\" (UniqueName: \"kubernetes.io/projected/49b93d08-be2a-41d0-9e3c-96f0f64e1906-kube-api-access-phsvg\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.047371 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047263 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047371 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047287 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvml\" (UniqueName: \"kubernetes.io/projected/27ee78eb-2bd4-446f-8ee3-fd763af995e8-kube-api-access-bdvml\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:38.047371 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047338 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047381 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047410 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc95l\" (UniqueName: \"kubernetes.io/projected/373b7aa7-5e36-48c8-b936-b75b188ca2f0-kube-api-access-rc95l\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047439 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njtpq\" (UniqueName: \"kubernetes.io/projected/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-kube-api-access-njtpq\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047462 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b93d08-be2a-41d0-9e3c-96f0f64e1906-klusterlet-config\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047492 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047541 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.047562 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b93d08-be2a-41d0-9e3c-96f0f64e1906-tmp\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047569 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-config-volume\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047595 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-tmp-dir\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.047614 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.047675 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.047686 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.547665171 +0000 UTC m=+34.168607137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:38.047909 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.047733 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:38.54771873 +0000 UTC m=+34.168660697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:05:38.048233 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.047945 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-tmp-dir\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.048318 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.048290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.048439 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.048417 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-config-volume\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.050154 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.050043 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.050154 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.050113 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.050538 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.050516 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.050652 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.050629 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b93d08-be2a-41d0-9e3c-96f0f64e1906-klusterlet-config\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.050747 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.050728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/373b7aa7-5e36-48c8-b936-b75b188ca2f0-ca\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.056491 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.056468 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvml\" (UniqueName: \"kubernetes.io/projected/27ee78eb-2bd4-446f-8ee3-fd763af995e8-kube-api-access-bdvml\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:38.056980 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.056930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phsvg\" (UniqueName: \"kubernetes.io/projected/49b93d08-be2a-41d0-9e3c-96f0f64e1906-kube-api-access-phsvg\") pod \"klusterlet-addon-workmgr-84d46748dc-pksrj\" (UID: \"49b93d08-be2a-41d0-9e3c-96f0f64e1906\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.057669 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.057641 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc95l\" (UniqueName: \"kubernetes.io/projected/373b7aa7-5e36-48c8-b936-b75b188ca2f0-kube-api-access-rc95l\") pod \"cluster-proxy-proxy-agent-7649949868-z8jqq\" (UID: \"373b7aa7-5e36-48c8-b936-b75b188ca2f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.057768 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.057710 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njtpq\" (UniqueName: \"kubernetes.io/projected/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-kube-api-access-njtpq\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.076100 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.076080 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" May 21 02:05:38.097682 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.097662 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:05:38.129433 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.129393 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:38.258850 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.258520 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq"] May 21 02:05:38.261130 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.261106 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh"] May 21 02:05:38.263095 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:38.263067 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod373b7aa7_5e36_48c8_b936_b75b188ca2f0.slice/crio-af949376dd77ca56aada3e41e5a845652b31b3638d404bfe8ae8024aec9f5402 WatchSource:0}: Error finding container af949376dd77ca56aada3e41e5a845652b31b3638d404bfe8ae8024aec9f5402: Status 404 returned error can't find the container with id af949376dd77ca56aada3e41e5a845652b31b3638d404bfe8ae8024aec9f5402 May 21 02:05:38.263937 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:38.263912 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e16c40a_d01e_44c3_bea4_8aaae3dce764.slice/crio-d2459b2c1ac9f3430165b3d9417f8cfa9036c467a5d98c558061074def28295b WatchSource:0}: Error finding container d2459b2c1ac9f3430165b3d9417f8cfa9036c467a5d98c558061074def28295b: Status 404 returned error can't find the container with id d2459b2c1ac9f3430165b3d9417f8cfa9036c467a5d98c558061074def28295b May 21 02:05:38.280080 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.280059 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj"] May 21 02:05:38.283022 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:38.282999 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b93d08_be2a_41d0_9e3c_96f0f64e1906.slice/crio-87d9319ba145a7e5922c9d969934ae4f8219adc29fc1de98196b33e6ecb51e41 WatchSource:0}: Error finding container 87d9319ba145a7e5922c9d969934ae4f8219adc29fc1de98196b33e6ecb51e41: Status 404 returned error can't find the container with id 87d9319ba145a7e5922c9d969934ae4f8219adc29fc1de98196b33e6ecb51e41 May 21 02:05:38.451243 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.451156 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:38.451243 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.451214 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:38.451411 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.451300 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:38.451411 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.451300 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:38.451411 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.451361 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:39.451345548 +0000 UTC m=+35.072287494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:38.451411 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.451311 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:38.451544 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.451426 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:05:39.451412673 +0000 UTC m=+35.072354634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:38.552537 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.552504 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:38.552671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.552556 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:38.552671 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.552660 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:38.552764 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.552699 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:38.552764 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.552735 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:39.552714314 +0000 UTC m=+35.173656276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:38.552764 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.552749 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:39.552743215 +0000 UTC m=+35.173685162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:05:38.652981 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.652926 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:38.653153 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.653018 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:38.653153 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653097 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:38.653153 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653121 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:38.653153 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653133 2552 projected.go:194] Error preparing data for projected volume kube-api-access-n6287 for pod openshift-network-diagnostics/network-check-target-c7g5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:38.653363 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653173 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:38.653363 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653201 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287 podName:fbc00dba-6714-42fd-813c-e207633c6cf8 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:10.653179637 +0000 UTC m=+66.274121588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n6287" (UniqueName: "kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287") pod "network-check-target-c7g5p" (UID: "fbc00dba-6714-42fd-813c-e207633c6cf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:38.653363 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:38.653234 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:10.653217783 +0000 UTC m=+66.274159742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:38.949610 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.949574 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:05:38.949767 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.949573 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:05:38.952847 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.952809 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97qx6\"" May 21 02:05:38.953264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.952857 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9f7\"" May 21 02:05:38.953264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.953077 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 02:05:38.953264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.953234 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 02:05:38.953264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:38.953251 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 02:05:39.098379 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.098345 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" event={"ID":"3e16c40a-d01e-44c3-bea4-8aaae3dce764","Type":"ContainerStarted","Data":"d2459b2c1ac9f3430165b3d9417f8cfa9036c467a5d98c558061074def28295b"} May 21 02:05:39.099511 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.099483 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" event={"ID":"49b93d08-be2a-41d0-9e3c-96f0f64e1906","Type":"ContainerStarted","Data":"87d9319ba145a7e5922c9d969934ae4f8219adc29fc1de98196b33e6ecb51e41"} May 21 02:05:39.100541 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.100513 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerStarted","Data":"af949376dd77ca56aada3e41e5a845652b31b3638d404bfe8ae8024aec9f5402"} May 21 02:05:39.460831 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.460802 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:39.461033 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.460887 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:39.461033 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.460974 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:39.461033 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.460997 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:39.461033 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.461019 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:39.461206 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.461065 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:05:41.461043523 +0000 UTC m=+37.081985484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:39.461206 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.461086 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:41.461074894 +0000 UTC m=+37.082016843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:39.561615 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.561580 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:39.561764 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.561689 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:39.561764 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:39.561730 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:39.561764 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.561753 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:41.561734986 +0000 UTC m=+37.182676932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:05:39.561936 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.561815 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:39.561936 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:39.561871 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:41.561852763 +0000 UTC m=+37.182794727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:41.479349 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:41.479305 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:41.479424 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.479449 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.479465 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.479524 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:05:45.479504973 +0000 UTC m=+41.100446920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.479547 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:41.479760 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.479581 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:45.47957081 +0000 UTC m=+41.100512770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:41.580294 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:41.580216 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:41.580294 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:41.580280 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:41.580499 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.580443 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:41.580548 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.580501 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:45.580483523 +0000 UTC m=+41.201425484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:05:41.580870 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.580751 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:41.580870 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:41.580827 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:45.580809459 +0000 UTC m=+41.201751421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:42.110089 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:42.109585 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="732280482af7af0193b1e22fdf1a85b72b60265eb012e03624e50a041a786846" exitCode=0 May 21 02:05:42.110089 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:42.109648 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"732280482af7af0193b1e22fdf1a85b72b60265eb012e03624e50a041a786846"} May 21 02:05:43.115312 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:43.115263 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerStarted","Data":"0f761620296a8c24e66a57754c51272c94b6e666d059edac07a20017b1e06c7f"} May 21 02:05:44.120882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:44.120648 2552 generic.go:358] "Generic (PLEG): container finished" podID="db43fb98-0b07-448c-abd1-52033ba1f2aa" containerID="0f761620296a8c24e66a57754c51272c94b6e666d059edac07a20017b1e06c7f" exitCode=0 May 21 02:05:44.121341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:44.120756 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerDied","Data":"0f761620296a8c24e66a57754c51272c94b6e666d059edac07a20017b1e06c7f"} May 21 02:05:45.511099 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:45.511063 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.511219 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.511244 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:45.511246 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.511314 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:05:53.511296029 +0000 UTC m=+49.132237998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.511361 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:45.511474 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.511407 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:53.511395899 +0000 UTC m=+49.132337851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:45.612558 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:45.612531 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:45.612681 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:45.612570 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:45.612681 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.612672 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:45.612751 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.612684 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:45.612751 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.612726 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:53.61270981 +0000 UTC m=+49.233651774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:45.612751 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:45.612744 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:05:53.612735106 +0000 UTC m=+49.233677056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:05:47.240692 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.240657 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ft8tt"] May 21 02:05:47.261814 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.261790 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ft8tt"] May 21 02:05:47.261960 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.261909 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.264522 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.264500 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 02:05:47.327992 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.327954 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-dbus\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.328122 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.328098 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d251bf9b-69de-4118-9cf4-0767ecba2b84-original-pull-secret\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.328185 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.328174 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-kubelet-config\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.429346 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.429319 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-dbus\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.429467 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.429433 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d251bf9b-69de-4118-9cf4-0767ecba2b84-original-pull-secret\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.429523 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.429493 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-kubelet-config\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.429596 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.429581 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-kubelet-config\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.429642 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.429618 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d251bf9b-69de-4118-9cf4-0767ecba2b84-dbus\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.433750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.433728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d251bf9b-69de-4118-9cf4-0767ecba2b84-original-pull-secret\") pod \"global-pull-secret-syncer-ft8tt\" (UID: \"d251bf9b-69de-4118-9cf4-0767ecba2b84\") " pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:47.571075 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:47.571049 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ft8tt" May 21 02:05:48.179653 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:48.179628 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ft8tt"] May 21 02:05:48.181832 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:05:48.181805 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd251bf9b_69de_4118_9cf4_0767ecba2b84.slice/crio-5a45d4e8e7ccf2b65aef0d1cdc84c33f0cf7fa5750c286c38ca63124a538f7a0 WatchSource:0}: Error finding container 5a45d4e8e7ccf2b65aef0d1cdc84c33f0cf7fa5750c286c38ca63124a538f7a0: Status 404 returned error can't find the container with id 5a45d4e8e7ccf2b65aef0d1cdc84c33f0cf7fa5750c286c38ca63124a538f7a0 May 21 02:05:49.131734 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.131688 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" event={"ID":"49b93d08-be2a-41d0-9e3c-96f0f64e1906","Type":"ContainerStarted","Data":"84d8ab8e52bc3df6a7ee4c3d5d5fa5758a24a7adfcfcb9b204ebfaf651898b56"} May 21 02:05:49.132723 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.131998 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:49.133476 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.133450 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerStarted","Data":"8c1375f55dd9eec63871a41d91119b256349f5b4d3323d0579f9b79e66a99e14"} May 21 02:05:49.133752 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.133635 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:05:49.136891 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.136860 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" event={"ID":"db43fb98-0b07-448c-abd1-52033ba1f2aa","Type":"ContainerStarted","Data":"8fd2defe1f14711ab30e078f29e4efc551b699dddbd48ad0003dd82424a85de8"} May 21 02:05:49.137918 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.137898 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ft8tt" event={"ID":"d251bf9b-69de-4118-9cf4-0767ecba2b84","Type":"ContainerStarted","Data":"5a45d4e8e7ccf2b65aef0d1cdc84c33f0cf7fa5750c286c38ca63124a538f7a0"} May 21 02:05:49.139247 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.139228 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" event={"ID":"3e16c40a-d01e-44c3-bea4-8aaae3dce764","Type":"ContainerStarted","Data":"368c315343bd9f86e7744c02337defe8ca1a0e9ac8cbdfd242cd9bd3a1214d40"} May 21 02:05:49.147301 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.147232 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" podStartSLOduration=24.364105664 podStartE2EDuration="34.147220224s" podCreationTimestamp="2026-05-21 02:05:15 +0000 UTC" firstStartedPulling="2026-05-21 02:05:38.284685794 +0000 UTC m=+33.905627758" lastFinishedPulling="2026-05-21 02:05:48.067800371 +0000 UTC m=+43.688742318" observedRunningTime="2026-05-21 02:05:49.146156413 +0000 UTC m=+44.767098383" watchObservedRunningTime="2026-05-21 02:05:49.147220224 +0000 UTC m=+44.768162192" May 21 02:05:49.166626 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.166580 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rk5l7" podStartSLOduration=10.760970176 podStartE2EDuration="44.166564509s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:05:07.619508079 +0000 UTC m=+3.240450026" lastFinishedPulling="2026-05-21 02:05:41.025102396 +0000 UTC m=+36.646044359" observedRunningTime="2026-05-21 02:05:49.164892498 +0000 UTC m=+44.785834469" watchObservedRunningTime="2026-05-21 02:05:49.166564509 +0000 UTC m=+44.787506483" May 21 02:05:49.193530 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:49.193487 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" podStartSLOduration=24.433458926 podStartE2EDuration="34.193472668s" podCreationTimestamp="2026-05-21 02:05:15 +0000 UTC" firstStartedPulling="2026-05-21 02:05:38.266143411 +0000 UTC m=+33.887085360" lastFinishedPulling="2026-05-21 02:05:48.026157141 +0000 UTC m=+43.647099102" observedRunningTime="2026-05-21 02:05:49.192753801 +0000 UTC m=+44.813695777" watchObservedRunningTime="2026-05-21 02:05:49.193472668 +0000 UTC m=+44.814414640" May 21 02:05:53.150325 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.150236 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerStarted","Data":"eb5697f0d4461df387694c4cc379c7852645f94d60087a9648c7465950f997ca"} May 21 02:05:53.150325 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.150276 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerStarted","Data":"05adf739e3751e6a9acf017a9fad7e6b3b58c82bd7016f15d2968bbe69f12443"} May 21 02:05:53.151533 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.151507 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ft8tt" event={"ID":"d251bf9b-69de-4118-9cf4-0767ecba2b84","Type":"ContainerStarted","Data":"4ddd9a6027879688a37fe135c071fc0065a8b207f5e23a133c3f102f80af4185"} May 21 02:05:53.168425 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.168384 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" podStartSLOduration=23.833477885 podStartE2EDuration="38.168372255s" podCreationTimestamp="2026-05-21 02:05:15 +0000 UTC" firstStartedPulling="2026-05-21 02:05:38.265530102 +0000 UTC m=+33.886472054" lastFinishedPulling="2026-05-21 02:05:52.600424477 +0000 UTC m=+48.221366424" observedRunningTime="2026-05-21 02:05:53.166777673 +0000 UTC m=+48.787719637" watchObservedRunningTime="2026-05-21 02:05:53.168372255 +0000 UTC m=+48.789314218" May 21 02:05:53.179717 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.179680 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ft8tt" podStartSLOduration=1.54403891 podStartE2EDuration="6.179668115s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:48.183711692 +0000 UTC m=+43.804653652" lastFinishedPulling="2026-05-21 02:05:52.8193409 +0000 UTC m=+48.440282857" observedRunningTime="2026-05-21 02:05:53.178842881 +0000 UTC m=+48.799784851" watchObservedRunningTime="2026-05-21 02:05:53.179668115 +0000 UTC m=+48.800610084" May 21 02:05:53.583873 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.583838 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:05:53.584044 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.583921 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:05:53.584044 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.584014 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:05:53.584127 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.584058 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:05:53.584127 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.584079 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:05:53.584127 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.584096 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:09.584078 +0000 UTC m=+65.205019959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:05:53.584127 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.584123 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:06:09.584107568 +0000 UTC m=+65.205049515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:05:53.684861 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.684834 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:05:53.685022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:05:53.684883 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:05:53.685022 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.684991 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:05:53.685022 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.685004 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:05:53.685126 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.685046 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:09.685030028 +0000 UTC m=+65.305971977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:05:53.685126 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:05:53.685061 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:09.685055879 +0000 UTC m=+65.305997826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:06:03.099550 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:03.099523 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhf6f" May 21 02:06:09.594169 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:09.594131 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:09.594224 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.594265 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.594338 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:41.594322796 +0000 UTC m=+97.215264748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.594360 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.594376 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:06:09.594674 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.594432 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:06:41.594414126 +0000 UTC m=+97.215356093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:06:09.694787 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:09.694759 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:06:09.694934 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:09.694807 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:06:09.694934 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.694886 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:09.694934 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.694895 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:09.695064 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.694942 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:41.69492884 +0000 UTC m=+97.315870787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:06:09.695064 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:09.694954 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:41.694948293 +0000 UTC m=+97.315890240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:06:10.701076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.701047 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:06:10.701474 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.701087 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:06:10.703543 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.703523 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 02:06:10.703636 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.703618 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 02:06:10.712086 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:10.712070 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 02:06:10.712154 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:10.712123 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:07:14.712108233 +0000 UTC m=+130.333050187 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : secret "metrics-daemon-secret" not found May 21 02:06:10.714525 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.714510 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 02:06:10.725116 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.725095 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6287\" (UniqueName: \"kubernetes.io/projected/fbc00dba-6714-42fd-813c-e207633c6cf8-kube-api-access-n6287\") pod \"network-check-target-c7g5p\" (UID: \"fbc00dba-6714-42fd-813c-e207633c6cf8\") " pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:06:10.787356 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.787333 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97qx6\"" May 21 02:06:10.795492 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.795475 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:06:10.911444 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:10.911418 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7g5p"] May 21 02:06:10.915813 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:06:10.915789 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc00dba_6714_42fd_813c_e207633c6cf8.slice/crio-f89a3f23c5d8cb3ec6ebfa1d093191773d88197102a2f6f11fc7301c01f05450 WatchSource:0}: Error finding container f89a3f23c5d8cb3ec6ebfa1d093191773d88197102a2f6f11fc7301c01f05450: Status 404 returned error can't find the container with id f89a3f23c5d8cb3ec6ebfa1d093191773d88197102a2f6f11fc7301c01f05450 May 21 02:06:11.200939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:11.200912 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7g5p" event={"ID":"fbc00dba-6714-42fd-813c-e207633c6cf8","Type":"ContainerStarted","Data":"f89a3f23c5d8cb3ec6ebfa1d093191773d88197102a2f6f11fc7301c01f05450"} May 21 02:06:15.212150 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:15.212074 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7g5p" event={"ID":"fbc00dba-6714-42fd-813c-e207633c6cf8","Type":"ContainerStarted","Data":"2226e911f7a483461d1c793bac185a90b81ab049c037cf0b5a5348a84c1ada82"} May 21 02:06:15.212488 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:15.212230 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:06:15.226791 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:15.226748 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c7g5p" podStartSLOduration=66.808064001 podStartE2EDuration="1m10.226736188s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:06:10.917571601 +0000 UTC m=+66.538513548" lastFinishedPulling="2026-05-21 02:06:14.336243775 +0000 UTC m=+69.957185735" observedRunningTime="2026-05-21 02:06:15.225864232 +0000 UTC m=+70.846806198" watchObservedRunningTime="2026-05-21 02:06:15.226736188 +0000 UTC m=+70.847678150" May 21 02:06:41.627430 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:41.627395 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:41.627455 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.627559 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.627583 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.627566 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.627651 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:07:45.627634838 +0000 UTC m=+161.248576787 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:06:41.627905 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.627715 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:07:45.627702164 +0000 UTC m=+161.248644117 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:06:41.728719 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:41.728690 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:06:41.728875 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:41.728735 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:06:41.728875 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.728835 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:41.728875 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.728844 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:41.728875 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.728879 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:07:45.728866693 +0000 UTC m=+161.349808644 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:06:41.729094 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:06:41.728912 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:07:45.72889349 +0000 UTC m=+161.349835447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:06:46.216841 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:06:46.216812 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c7g5p" May 21 02:07:14.752337 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:14.752294 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:07:14.752872 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:14.752455 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 02:07:14.752872 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:14.752546 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs podName:cbe31c48-085f-4d57-9709-eabdf2ae3113 nodeName:}" failed. No retries permitted until 2026-05-21 02:09:16.752527787 +0000 UTC m=+252.373469734 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs") pod "network-metrics-daemon-wzdpr" (UID: "cbe31c48-085f-4d57-9709-eabdf2ae3113") : secret "metrics-daemon-secret" not found May 21 02:07:40.784046 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:40.784001 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" podUID="c829d797-891b-4962-9c7e-5ba537adb281" May 21 02:07:40.791174 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:40.791143 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" podUID="e35ef80a-cb14-4193-97af-5caa172b0afc" May 21 02:07:40.840527 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:40.840505 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jkdrp" podUID="27ee78eb-2bd4-446f-8ee3-fd763af995e8" May 21 02:07:40.853673 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:40.853648 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8h7nk" podUID="0f12ba82-e7fa-4d58-9e4c-d495e49c2a26" May 21 02:07:41.419009 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:41.418981 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:07:41.419153 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:41.418981 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:07:41.419153 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:41.418985 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:07:41.979891 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:41.979850 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wzdpr" podUID="cbe31c48-085f-4d57-9709-eabdf2ae3113" May 21 02:07:45.666213 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:45.666162 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") pod \"image-registry-bb74756c6-jjn62\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.666313 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.666334 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb74756c6-jjn62: secret "image-registry-tls" not found May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:45.666327 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.666390 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls podName:e35ef80a-cb14-4193-97af-5caa172b0afc nodeName:}" failed. No retries permitted until 2026-05-21 02:09:47.66637175 +0000 UTC m=+283.287313697 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls") pod "image-registry-bb74756c6-jjn62" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc") : secret "image-registry-tls" not found May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.666439 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 02:07:45.666640 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.666498 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert podName:c829d797-891b-4962-9c7e-5ba537adb281 nodeName:}" failed. No retries permitted until 2026-05-21 02:09:47.666483725 +0000 UTC m=+283.287425676 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-x5xwf" (UID: "c829d797-891b-4962-9c7e-5ba537adb281") : secret "networking-console-plugin-cert" not found May 21 02:07:45.765098 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:45.765073 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gg4lt_8b35b488-aed7-4e2b-b946-008b29b38c79/dns-node-resolver/0.log" May 21 02:07:45.767282 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:45.767256 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:07:45.767419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:45.767320 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:07:45.767419 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.767400 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:07:45.767495 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.767455 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls podName:0f12ba82-e7fa-4d58-9e4c-d495e49c2a26 nodeName:}" failed. No retries permitted until 2026-05-21 02:09:47.767442476 +0000 UTC m=+283.388384423 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls") pod "dns-default-8h7nk" (UID: "0f12ba82-e7fa-4d58-9e4c-d495e49c2a26") : secret "dns-default-metrics-tls" not found May 21 02:07:45.767495 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.767407 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:07:45.767564 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:07:45.767543 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert podName:27ee78eb-2bd4-446f-8ee3-fd763af995e8 nodeName:}" failed. No retries permitted until 2026-05-21 02:09:47.767531006 +0000 UTC m=+283.388472958 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert") pod "ingress-canary-jkdrp" (UID: "27ee78eb-2bd4-446f-8ee3-fd763af995e8") : secret "canary-serving-cert" not found May 21 02:07:46.563843 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:46.563812 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6dg7x_5be69ed9-72da-481e-b8b4-a83fbb16cb4a/node-ca/0.log" May 21 02:07:48.436698 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.436673 2552 generic.go:358] "Generic (PLEG): container finished" podID="49b93d08-be2a-41d0-9e3c-96f0f64e1906" containerID="84d8ab8e52bc3df6a7ee4c3d5d5fa5758a24a7adfcfcb9b204ebfaf651898b56" exitCode=1 May 21 02:07:48.437076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.436754 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" event={"ID":"49b93d08-be2a-41d0-9e3c-96f0f64e1906","Type":"ContainerDied","Data":"84d8ab8e52bc3df6a7ee4c3d5d5fa5758a24a7adfcfcb9b204ebfaf651898b56"} May 21 02:07:48.437161 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.437144 2552 scope.go:117] "RemoveContainer" containerID="84d8ab8e52bc3df6a7ee4c3d5d5fa5758a24a7adfcfcb9b204ebfaf651898b56" May 21 02:07:48.441784 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.441746 2552 generic.go:358] "Generic (PLEG): container finished" podID="3e16c40a-d01e-44c3-bea4-8aaae3dce764" containerID="368c315343bd9f86e7744c02337defe8ca1a0e9ac8cbdfd242cd9bd3a1214d40" exitCode=255 May 21 02:07:48.441942 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.441806 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" event={"ID":"3e16c40a-d01e-44c3-bea4-8aaae3dce764","Type":"ContainerDied","Data":"368c315343bd9f86e7744c02337defe8ca1a0e9ac8cbdfd242cd9bd3a1214d40"} May 21 02:07:48.442141 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:48.442121 2552 scope.go:117] "RemoveContainer" containerID="368c315343bd9f86e7744c02337defe8ca1a0e9ac8cbdfd242cd9bd3a1214d40" May 21 02:07:49.132608 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:49.132579 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:07:49.446561 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:49.446458 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" event={"ID":"49b93d08-be2a-41d0-9e3c-96f0f64e1906","Type":"ContainerStarted","Data":"aca711eff9fe03c6edf5c259af226ef145bc93ebfd46ee779cb8e1b37cacdf75"} May 21 02:07:49.447079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:49.446679 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:07:49.447449 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:49.447424 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84d46748dc-pksrj" May 21 02:07:49.448504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:49.448481 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bbb66c944-9gnlh" event={"ID":"3e16c40a-d01e-44c3-bea4-8aaae3dce764","Type":"ContainerStarted","Data":"186886c3c827144b3b8cfdb8da5de4cc8cffb189398d256d3228262d83a6e8ce"} May 21 02:07:53.948882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:53.948844 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:07:53.948882 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:07:53.948847 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8h7nk" May 21 02:08:09.402661 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.402627 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hb"] May 21 02:08:09.405756 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.405737 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.408108 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.408084 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5xl8\"" May 21 02:08:09.408205 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.408115 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 02:08:09.408205 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.408124 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 02:08:09.408448 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.408434 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 02:08:09.409133 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.409121 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 02:08:09.415910 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.415882 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hb"] May 21 02:08:09.538884 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.538865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8ea7904-4f3f-417a-a04e-9d57818cecd2-crio-socket\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.538995 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.538921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.538995 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.538952 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8ea7904-4f3f-417a-a04e-9d57818cecd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.538995 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.538988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8df\" (UniqueName: \"kubernetes.io/projected/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-api-access-8w8df\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.539115 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.539089 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8ea7904-4f3f-417a-a04e-9d57818cecd2-data-volume\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.639724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639701 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8ea7904-4f3f-417a-a04e-9d57818cecd2-crio-socket\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.639826 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639750 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.639826 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639767 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8ea7904-4f3f-417a-a04e-9d57818cecd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.639826 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639784 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8df\" (UniqueName: \"kubernetes.io/projected/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-api-access-8w8df\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.640007 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639831 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8ea7904-4f3f-417a-a04e-9d57818cecd2-crio-socket\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.640007 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.639925 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8ea7904-4f3f-417a-a04e-9d57818cecd2-data-volume\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.640217 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.640191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8ea7904-4f3f-417a-a04e-9d57818cecd2-data-volume\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.640280 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.640223 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.642095 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.642075 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8ea7904-4f3f-417a-a04e-9d57818cecd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.646816 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.646795 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8df\" (UniqueName: \"kubernetes.io/projected/d8ea7904-4f3f-417a-a04e-9d57818cecd2-kube-api-access-8w8df\") pod \"insights-runtime-extractor-7h8hb\" (UID: \"d8ea7904-4f3f-417a-a04e-9d57818cecd2\") " pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.714454 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.714405 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7h8hb" May 21 02:08:09.830028 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:09.829998 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hb"] May 21 02:08:09.835505 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:08:09.835481 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ea7904_4f3f_417a_a04e_9d57818cecd2.slice/crio-234925a4f14c29ca9fb34273e4d54e8d645105b0a0bbdab24befface3fe5c203 WatchSource:0}: Error finding container 234925a4f14c29ca9fb34273e4d54e8d645105b0a0bbdab24befface3fe5c203: Status 404 returned error can't find the container with id 234925a4f14c29ca9fb34273e4d54e8d645105b0a0bbdab24befface3fe5c203 May 21 02:08:10.507458 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:10.507387 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hb" event={"ID":"d8ea7904-4f3f-417a-a04e-9d57818cecd2","Type":"ContainerStarted","Data":"a6b7e4ceb0b9be03dbd5e92b5f191153f697b1f6677632faa139f1615a20ede1"} May 21 02:08:10.507841 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:10.507483 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hb" event={"ID":"d8ea7904-4f3f-417a-a04e-9d57818cecd2","Type":"ContainerStarted","Data":"234925a4f14c29ca9fb34273e4d54e8d645105b0a0bbdab24befface3fe5c203"} May 21 02:08:11.511585 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:11.511548 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hb" event={"ID":"d8ea7904-4f3f-417a-a04e-9d57818cecd2","Type":"ContainerStarted","Data":"10b1200f814f79efd9b992b1d3751ff8a0dee4558f6daaec3ace818d7717e017"} May 21 02:08:12.518530 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:12.518496 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hb" event={"ID":"d8ea7904-4f3f-417a-a04e-9d57818cecd2","Type":"ContainerStarted","Data":"ffcc80cdd00603f48e970b260d0246a2ea3fe321690d5880213c7856d7ef80c4"} May 21 02:08:12.538850 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:12.538806 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7h8hb" podStartSLOduration=1.175314715 podStartE2EDuration="3.538793694s" podCreationTimestamp="2026-05-21 02:08:09 +0000 UTC" firstStartedPulling="2026-05-21 02:08:09.89225244 +0000 UTC m=+185.513194387" lastFinishedPulling="2026-05-21 02:08:12.255731416 +0000 UTC m=+187.876673366" observedRunningTime="2026-05-21 02:08:12.53786815 +0000 UTC m=+188.158810112" watchObservedRunningTime="2026-05-21 02:08:12.538793694 +0000 UTC m=+188.159735717" May 21 02:08:24.377648 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.377618 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcq8q"] May 21 02:08:24.380628 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.380611 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.384256 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.384230 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 02:08:24.384381 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.384261 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 02:08:24.384381 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.384313 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w4qsv\"" May 21 02:08:24.384980 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.384946 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 02:08:24.385517 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.385499 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 02:08:24.385588 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.385527 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 02:08:24.385588 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.385504 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 02:08:24.442938 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.442912 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-wtmp\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443044 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.442949 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dw4r\" (UniqueName: \"kubernetes.io/projected/e12927a8-3e93-49f7-822c-36bf79cef710-kube-api-access-5dw4r\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443087 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443087 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-root\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443171 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443171 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-textfile\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443242 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443170 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-metrics-client-ca\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443242 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.443317 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.443237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-sys\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544174 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544141 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544275 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544192 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-root\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544275 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544269 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-root\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544320 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544346 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-textfile\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544520 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:08:24.544436 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 02:08:24.544520 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544448 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-metrics-client-ca\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544520 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544474 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544520 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:08:24.544505 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls podName:e12927a8-3e93-49f7-822c-36bf79cef710 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:25.044486187 +0000 UTC m=+200.665428158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls") pod "node-exporter-kcq8q" (UID: "e12927a8-3e93-49f7-822c-36bf79cef710") : secret "node-exporter-tls" not found May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544556 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-sys\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544584 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-wtmp\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544615 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dw4r\" (UniqueName: \"kubernetes.io/projected/e12927a8-3e93-49f7-822c-36bf79cef710-kube-api-access-5dw4r\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544626 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-sys\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544584 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-textfile\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.544724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544679 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.545000 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544765 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-wtmp\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.545000 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.544895 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12927a8-3e93-49f7-822c-36bf79cef710-metrics-client-ca\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.546663 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.546636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:24.552991 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:24.552952 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dw4r\" (UniqueName: \"kubernetes.io/projected/e12927a8-3e93-49f7-822c-36bf79cef710-kube-api-access-5dw4r\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:25.049163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:25.049137 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:25.051348 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:25.051320 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12927a8-3e93-49f7-822c-36bf79cef710-node-exporter-tls\") pod \"node-exporter-kcq8q\" (UID: \"e12927a8-3e93-49f7-822c-36bf79cef710\") " pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:25.289291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:25.289253 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcq8q" May 21 02:08:25.297688 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:08:25.297659 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12927a8_3e93_49f7_822c_36bf79cef710.slice/crio-a1d4ff65fda9d8d7aeacffec795b9687d7b66a106b909554125b45e2e66cff1e WatchSource:0}: Error finding container a1d4ff65fda9d8d7aeacffec795b9687d7b66a106b909554125b45e2e66cff1e: Status 404 returned error can't find the container with id a1d4ff65fda9d8d7aeacffec795b9687d7b66a106b909554125b45e2e66cff1e May 21 02:08:25.556496 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:25.556407 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcq8q" event={"ID":"e12927a8-3e93-49f7-822c-36bf79cef710","Type":"ContainerStarted","Data":"a1d4ff65fda9d8d7aeacffec795b9687d7b66a106b909554125b45e2e66cff1e"} May 21 02:08:26.560369 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:26.560337 2552 generic.go:358] "Generic (PLEG): container finished" podID="e12927a8-3e93-49f7-822c-36bf79cef710" containerID="cd10b64555e07b9357c7fa3b335767bff0444ef3784e8ce914fe5715c2a0ff84" exitCode=0 May 21 02:08:26.560660 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:26.560380 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcq8q" event={"ID":"e12927a8-3e93-49f7-822c-36bf79cef710","Type":"ContainerDied","Data":"cd10b64555e07b9357c7fa3b335767bff0444ef3784e8ce914fe5715c2a0ff84"} May 21 02:08:27.566958 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:27.566918 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcq8q" event={"ID":"e12927a8-3e93-49f7-822c-36bf79cef710","Type":"ContainerStarted","Data":"199874ecc61a30663bf70259d91fa856cec1a71270320c721efdd6b6dd8508c8"} May 21 02:08:27.566958 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:27.566956 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcq8q" event={"ID":"e12927a8-3e93-49f7-822c-36bf79cef710","Type":"ContainerStarted","Data":"9e11f8459128ff4f402b8c8d213cfb098d5ae365040635ad9efa407a4ce81af5"} May 21 02:08:27.585229 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:27.585185 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcq8q" podStartSLOduration=2.564251223 podStartE2EDuration="3.585174145s" podCreationTimestamp="2026-05-21 02:08:24 +0000 UTC" firstStartedPulling="2026-05-21 02:08:25.299683288 +0000 UTC m=+200.920625238" lastFinishedPulling="2026-05-21 02:08:26.32060621 +0000 UTC m=+201.941548160" observedRunningTime="2026-05-21 02:08:27.583799075 +0000 UTC m=+203.204741044" watchObservedRunningTime="2026-05-21 02:08:27.585174145 +0000 UTC m=+203.206116113" May 21 02:08:28.099160 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:28.099109 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" podUID="373b7aa7-5e36-48c8-b936-b75b188ca2f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 02:08:38.099618 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:38.099576 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" podUID="373b7aa7-5e36-48c8-b936-b75b188ca2f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 02:08:48.098743 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.098703 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" podUID="373b7aa7-5e36-48c8-b936-b75b188ca2f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 02:08:48.099124 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.098771 2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" May 21 02:08:48.099320 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.099289 2552 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"eb5697f0d4461df387694c4cc379c7852645f94d60087a9648c7465950f997ca"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 02:08:48.099373 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.099358 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" podUID="373b7aa7-5e36-48c8-b936-b75b188ca2f0" containerName="service-proxy" containerID="cri-o://eb5697f0d4461df387694c4cc379c7852645f94d60087a9648c7465950f997ca" gracePeriod=30 May 21 02:08:48.623979 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.623930 2552 generic.go:358] "Generic (PLEG): container finished" podID="373b7aa7-5e36-48c8-b936-b75b188ca2f0" containerID="eb5697f0d4461df387694c4cc379c7852645f94d60087a9648c7465950f997ca" exitCode=2 May 21 02:08:48.624137 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.624002 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerDied","Data":"eb5697f0d4461df387694c4cc379c7852645f94d60087a9648c7465950f997ca"} May 21 02:08:48.624137 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:48.624038 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7649949868-z8jqq" event={"ID":"373b7aa7-5e36-48c8-b936-b75b188ca2f0","Type":"ContainerStarted","Data":"e0904e0a8b17ff1a31d652b572b095e256b60a55d972043cdf0979b1a36c5486"} May 21 02:08:59.735457 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:08:59.735424 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb74756c6-jjn62"] May 21 02:08:59.736057 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:08:59.735576 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" podUID="e35ef80a-cb14-4193-97af-5caa172b0afc" May 21 02:09:00.655063 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.655030 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:09:00.659502 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.659477 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:09:00.711865 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.711845 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.711978 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.711880 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.711978 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.711913 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.711978 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.711955 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2btb\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.712097 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712010 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.712097 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712047 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.712097 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712079 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration\") pod \"e35ef80a-cb14-4193-97af-5caa172b0afc\" (UID: \"e35ef80a-cb14-4193-97af-5caa172b0afc\") " May 21 02:09:00.712255 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712233 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:09:00.712310 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712302 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e35ef80a-cb14-4193-97af-5caa172b0afc-ca-trust-extracted\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.712367 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712295 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:00.712510 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.712485 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:00.714587 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.714552 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:09:00.714707 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.714609 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:09:00.714707 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.714638 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb" (OuterVolumeSpecName: "kube-api-access-c2btb") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "kube-api-access-c2btb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:09:00.714707 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.714680 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e35ef80a-cb14-4193-97af-5caa172b0afc" (UID: "e35ef80a-cb14-4193-97af-5caa172b0afc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:09:00.813213 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813186 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-installation-pull-secrets\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.813213 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813208 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2btb\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-kube-api-access-c2btb\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.813504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813218 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-certificates\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.813504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813227 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-bound-sa-token\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.813504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813237 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e35ef80a-cb14-4193-97af-5caa172b0afc-image-registry-private-configuration\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:00.813504 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:00.813247 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e35ef80a-cb14-4193-97af-5caa172b0afc-trusted-ca\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:01.657770 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:01.657738 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb74756c6-jjn62" May 21 02:09:01.687331 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:01.687302 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb74756c6-jjn62"] May 21 02:09:01.690471 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:01.690448 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bb74756c6-jjn62"] May 21 02:09:01.820023 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:01.820000 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e35ef80a-cb14-4193-97af-5caa172b0afc-registry-tls\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:09:02.952014 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:02.951982 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e35ef80a-cb14-4193-97af-5caa172b0afc" path="/var/lib/kubelet/pods/e35ef80a-cb14-4193-97af-5caa172b0afc/volumes" May 21 02:09:05.054259 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:05.054234 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/init-textfile/0.log" May 21 02:09:05.250445 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:05.250415 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/node-exporter/0.log" May 21 02:09:05.450160 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:05.450068 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/kube-rbac-proxy/0.log" May 21 02:09:12.252786 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:12.252758 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gg4lt_8b35b488-aed7-4e2b-b946-008b29b38c79/dns-node-resolver/0.log" May 21 02:09:13.053050 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:13.053019 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6dg7x_5be69ed9-72da-481e-b8b4-a83fbb16cb4a/node-ca/0.log" May 21 02:09:16.835620 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:16.835582 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:09:16.837937 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:16.837915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbe31c48-085f-4d57-9709-eabdf2ae3113-metrics-certs\") pod \"network-metrics-daemon-wzdpr\" (UID: \"cbe31c48-085f-4d57-9709-eabdf2ae3113\") " pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:09:17.053023 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:17.052995 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9f7\"" May 21 02:09:17.061375 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:17.061356 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzdpr" May 21 02:09:17.180189 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:17.180161 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzdpr"] May 21 02:09:17.183459 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:09:17.183430 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe31c48_085f_4d57_9709_eabdf2ae3113.slice/crio-878379b5cd5af849a6075e307ac3d4200be158c185902f5b5d4d0b2187fd18e2 WatchSource:0}: Error finding container 878379b5cd5af849a6075e307ac3d4200be158c185902f5b5d4d0b2187fd18e2: Status 404 returned error can't find the container with id 878379b5cd5af849a6075e307ac3d4200be158c185902f5b5d4d0b2187fd18e2 May 21 02:09:17.699652 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:17.699618 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzdpr" event={"ID":"cbe31c48-085f-4d57-9709-eabdf2ae3113","Type":"ContainerStarted","Data":"878379b5cd5af849a6075e307ac3d4200be158c185902f5b5d4d0b2187fd18e2"} May 21 02:09:18.703394 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:18.703360 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzdpr" event={"ID":"cbe31c48-085f-4d57-9709-eabdf2ae3113","Type":"ContainerStarted","Data":"b07254ae3ec277a2317fe82bca3476cab604d6247ea839d483e9bb0ebe7cd6bb"} May 21 02:09:18.703394 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:18.703396 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzdpr" event={"ID":"cbe31c48-085f-4d57-9709-eabdf2ae3113","Type":"ContainerStarted","Data":"f5a90b05af139dfbc9ebce244a8764662763beed2d3e9d742ed98994bd1c4c3f"} May 21 02:09:18.718868 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:18.718816 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wzdpr" podStartSLOduration=252.742129857 podStartE2EDuration="4m13.71880273s" podCreationTimestamp="2026-05-21 02:05:05 +0000 UTC" firstStartedPulling="2026-05-21 02:09:17.185139547 +0000 UTC m=+252.806081497" lastFinishedPulling="2026-05-21 02:09:18.161812419 +0000 UTC m=+253.782754370" observedRunningTime="2026-05-21 02:09:18.71772323 +0000 UTC m=+254.338665199" watchObservedRunningTime="2026-05-21 02:09:18.71880273 +0000 UTC m=+254.339744699" May 21 02:09:44.420342 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:09:44.420295 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" podUID="c829d797-891b-4962-9c7e-5ba537adb281" May 21 02:09:44.420342 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:09:44.420283 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jkdrp" podUID="27ee78eb-2bd4-446f-8ee3-fd763af995e8" May 21 02:09:44.772471 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:44.772444 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:09:44.772618 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:44.772444 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:09:47.754296 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.754255 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:09:47.756538 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.756521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c829d797-891b-4962-9c7e-5ba537adb281-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-x5xwf\" (UID: \"c829d797-891b-4962-9c7e-5ba537adb281\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:09:47.775215 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.775194 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wsxkz\"" May 21 02:09:47.783633 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.783617 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" May 21 02:09:47.855699 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.855667 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:09:47.855861 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.855719 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:09:47.858165 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.858142 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f12ba82-e7fa-4d58-9e4c-d495e49c2a26-metrics-tls\") pod \"dns-default-8h7nk\" (UID: \"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26\") " pod="openshift-dns/dns-default-8h7nk" May 21 02:09:47.858243 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.858182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27ee78eb-2bd4-446f-8ee3-fd763af995e8-cert\") pod \"ingress-canary-jkdrp\" (UID: \"27ee78eb-2bd4-446f-8ee3-fd763af995e8\") " pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:09:47.904091 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.904057 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf"] May 21 02:09:47.906988 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:09:47.906949 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc829d797_891b_4962_9c7e_5ba537adb281.slice/crio-cecfd76b5fd6c8a9b91a4fd816ed9ca5a97d592ad2c9adbc13d10c65c8ab9ecf WatchSource:0}: Error finding container cecfd76b5fd6c8a9b91a4fd816ed9ca5a97d592ad2c9adbc13d10c65c8ab9ecf: Status 404 returned error can't find the container with id cecfd76b5fd6c8a9b91a4fd816ed9ca5a97d592ad2c9adbc13d10c65c8ab9ecf May 21 02:09:47.952166 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.952145 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2mvhm\"" May 21 02:09:47.960231 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:47.960212 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8h7nk" May 21 02:09:48.075116 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.075072 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8h7nk"] May 21 02:09:48.075499 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.075479 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x7bwd\"" May 21 02:09:48.077849 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:09:48.077826 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f12ba82_e7fa_4d58_9e4c_d495e49c2a26.slice/crio-813d2f35a94cfb0a12b3f708d7d5400e92911fec75e043a904afa07fbad335d5 WatchSource:0}: Error finding container 813d2f35a94cfb0a12b3f708d7d5400e92911fec75e043a904afa07fbad335d5: Status 404 returned error can't find the container with id 813d2f35a94cfb0a12b3f708d7d5400e92911fec75e043a904afa07fbad335d5 May 21 02:09:48.083720 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.083702 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkdrp" May 21 02:09:48.201159 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.201098 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkdrp"] May 21 02:09:48.203745 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:09:48.203709 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ee78eb_2bd4_446f_8ee3_fd763af995e8.slice/crio-5f31eb3d562774d68261ef65fcb0b8653b21c202cbe49a5f48b5a3528691a012 WatchSource:0}: Error finding container 5f31eb3d562774d68261ef65fcb0b8653b21c202cbe49a5f48b5a3528691a012: Status 404 returned error can't find the container with id 5f31eb3d562774d68261ef65fcb0b8653b21c202cbe49a5f48b5a3528691a012 May 21 02:09:48.783144 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.783090 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkdrp" event={"ID":"27ee78eb-2bd4-446f-8ee3-fd763af995e8","Type":"ContainerStarted","Data":"5f31eb3d562774d68261ef65fcb0b8653b21c202cbe49a5f48b5a3528691a012"} May 21 02:09:48.784677 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.784649 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8h7nk" event={"ID":"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26","Type":"ContainerStarted","Data":"813d2f35a94cfb0a12b3f708d7d5400e92911fec75e043a904afa07fbad335d5"} May 21 02:09:48.785945 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:48.785916 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" event={"ID":"c829d797-891b-4962-9c7e-5ba537adb281","Type":"ContainerStarted","Data":"cecfd76b5fd6c8a9b91a4fd816ed9ca5a97d592ad2c9adbc13d10c65c8ab9ecf"} May 21 02:09:50.793664 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.793629 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkdrp" event={"ID":"27ee78eb-2bd4-446f-8ee3-fd763af995e8","Type":"ContainerStarted","Data":"2f4b9071c691b8370583135a5deb859fcf94bc3d778c2249d99990b29a717fc1"} May 21 02:09:50.795172 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.795146 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8h7nk" event={"ID":"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26","Type":"ContainerStarted","Data":"d0743cea05528e34f732f65bc1fd351bb1a6fe4b1b2564cabfda7c8d34a4ab0a"} May 21 02:09:50.795279 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.795181 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8h7nk" event={"ID":"0f12ba82-e7fa-4d58-9e4c-d495e49c2a26","Type":"ContainerStarted","Data":"01fd0376ace787062d722e14e3d8f306d8bde61cf2d153105e0480649270dff7"} May 21 02:09:50.795279 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.795208 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8h7nk" May 21 02:09:50.796364 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.796342 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" event={"ID":"c829d797-891b-4962-9c7e-5ba537adb281","Type":"ContainerStarted","Data":"19ab03ada6b53c4cf50b520ae66e0bd61b0489be2fc3096ca110d307483c5d3f"} May 21 02:09:50.808389 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.808348 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jkdrp" podStartSLOduration=251.753658619 podStartE2EDuration="4m13.808336916s" podCreationTimestamp="2026-05-21 02:05:37 +0000 UTC" firstStartedPulling="2026-05-21 02:09:48.20550102 +0000 UTC m=+283.826442969" lastFinishedPulling="2026-05-21 02:09:50.260179306 +0000 UTC m=+285.881121266" observedRunningTime="2026-05-21 02:09:50.807432143 +0000 UTC m=+286.428374112" watchObservedRunningTime="2026-05-21 02:09:50.808336916 +0000 UTC m=+286.429278907" May 21 02:09:50.820711 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.820660 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-x5xwf" podStartSLOduration=260.475511652 podStartE2EDuration="4m22.820645751s" podCreationTimestamp="2026-05-21 02:05:28 +0000 UTC" firstStartedPulling="2026-05-21 02:09:47.908703091 +0000 UTC m=+283.529645038" lastFinishedPulling="2026-05-21 02:09:50.253837187 +0000 UTC m=+285.874779137" observedRunningTime="2026-05-21 02:09:50.820101129 +0000 UTC m=+286.441043098" watchObservedRunningTime="2026-05-21 02:09:50.820645751 +0000 UTC m=+286.441587721" May 21 02:09:50.837319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:09:50.837281 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8h7nk" podStartSLOduration=251.661779757 podStartE2EDuration="4m13.837271353s" podCreationTimestamp="2026-05-21 02:05:37 +0000 UTC" firstStartedPulling="2026-05-21 02:09:48.079500267 +0000 UTC m=+283.700442215" lastFinishedPulling="2026-05-21 02:09:50.254991852 +0000 UTC m=+285.875933811" observedRunningTime="2026-05-21 02:09:50.83623548 +0000 UTC m=+286.457177449" watchObservedRunningTime="2026-05-21 02:09:50.837271353 +0000 UTC m=+286.458213322" May 21 02:10:00.802529 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:10:00.802493 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8h7nk" May 21 02:10:04.895455 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:10:04.895427 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:10:04.896881 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:10:04.896857 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:10:04.901023 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:10:04.901002 2552 kubelet.go:1628] "Image garbage collection succeeded" May 21 02:11:48.735442 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.735411 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96"] May 21 02:11:48.738219 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.738202 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.740714 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.740689 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 02:11:48.741734 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.741707 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 02:11:48.741823 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.741736 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mxfph\"" May 21 02:11:48.745263 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.745243 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96"] May 21 02:11:48.838734 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.838706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nccdf\" (UniqueName: \"kubernetes.io/projected/2726f6f5-3116-405e-8c63-6668ca8cec23-kube-api-access-nccdf\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.838869 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.838759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2726f6f5-3116-405e-8c63-6668ca8cec23-tmp\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.939201 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.939165 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nccdf\" (UniqueName: \"kubernetes.io/projected/2726f6f5-3116-405e-8c63-6668ca8cec23-kube-api-access-nccdf\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.939291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.939225 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2726f6f5-3116-405e-8c63-6668ca8cec23-tmp\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.939520 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.939505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2726f6f5-3116-405e-8c63-6668ca8cec23-tmp\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:48.952839 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:48.952815 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nccdf\" (UniqueName: \"kubernetes.io/projected/2726f6f5-3116-405e-8c63-6668ca8cec23-kube-api-access-nccdf\") pod \"openshift-lws-operator-bfc7f696d-xwq96\" (UID: \"2726f6f5-3116-405e-8c63-6668ca8cec23\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:49.047610 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:49.047588 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" May 21 02:11:49.168315 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:49.168275 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96"] May 21 02:11:49.171981 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:11:49.171942 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2726f6f5_3116_405e_8c63_6668ca8cec23.slice/crio-a15ba276eef3c35c3f2fe5ab85cbccd3afdd342af4a20590149b97f623200469 WatchSource:0}: Error finding container a15ba276eef3c35c3f2fe5ab85cbccd3afdd342af4a20590149b97f623200469: Status 404 returned error can't find the container with id a15ba276eef3c35c3f2fe5ab85cbccd3afdd342af4a20590149b97f623200469 May 21 02:11:49.173305 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:49.173286 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:11:50.124384 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:50.124345 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" event={"ID":"2726f6f5-3116-405e-8c63-6668ca8cec23","Type":"ContainerStarted","Data":"a15ba276eef3c35c3f2fe5ab85cbccd3afdd342af4a20590149b97f623200469"} May 21 02:11:52.131039 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:52.130994 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" event={"ID":"2726f6f5-3116-405e-8c63-6668ca8cec23","Type":"ContainerStarted","Data":"872a4e4f42d4c07ac6d77c1604db18bae8a379438c29c85b4699cf801620932c"} May 21 02:11:52.148020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:11:52.147960 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xwq96" podStartSLOduration=1.384398304 podStartE2EDuration="4.147945739s" podCreationTimestamp="2026-05-21 02:11:48 +0000 UTC" firstStartedPulling="2026-05-21 02:11:49.173407036 +0000 UTC m=+404.794348984" lastFinishedPulling="2026-05-21 02:11:51.93695447 +0000 UTC m=+407.557896419" observedRunningTime="2026-05-21 02:11:52.146201559 +0000 UTC m=+407.767143528" watchObservedRunningTime="2026-05-21 02:11:52.147945739 +0000 UTC m=+407.768887708" May 21 02:12:09.574669 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.574627 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp"] May 21 02:12:09.577984 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.577946 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.580740 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.580712 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 02:12:09.580840 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.580741 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 02:12:09.580840 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.580816 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rlcrz\"" May 21 02:12:09.581213 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.581194 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 02:12:09.581381 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.581366 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 02:12:09.589197 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.589175 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp"] May 21 02:12:09.673350 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.673320 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4jv\" (UniqueName: \"kubernetes.io/projected/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-kube-api-access-lt4jv\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.673441 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.673377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.673497 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.673471 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.774584 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.774559 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.774687 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.774597 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4jv\" (UniqueName: \"kubernetes.io/projected/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-kube-api-access-lt4jv\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.774758 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.774733 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.776812 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.776787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.776995 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.776978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.784011 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.783993 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4jv\" (UniqueName: \"kubernetes.io/projected/f3c7fb2b-ce85-411e-b098-4f8af7b914c9-kube-api-access-lt4jv\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-2mkvp\" (UID: \"f3c7fb2b-ce85-411e-b098-4f8af7b914c9\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:09.887865 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:09.887818 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:10.014823 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:10.014791 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp"] May 21 02:12:10.017848 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:12:10.017822 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c7fb2b_ce85_411e_b098_4f8af7b914c9.slice/crio-e427d5792fb45f4c495fc15ddb19f9410b24be0e04a4fa8e84caf1a878685d46 WatchSource:0}: Error finding container e427d5792fb45f4c495fc15ddb19f9410b24be0e04a4fa8e84caf1a878685d46: Status 404 returned error can't find the container with id e427d5792fb45f4c495fc15ddb19f9410b24be0e04a4fa8e84caf1a878685d46 May 21 02:12:10.182849 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:10.182786 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" event={"ID":"f3c7fb2b-ce85-411e-b098-4f8af7b914c9","Type":"ContainerStarted","Data":"e427d5792fb45f4c495fc15ddb19f9410b24be0e04a4fa8e84caf1a878685d46"} May 21 02:12:13.192704 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:13.192662 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" event={"ID":"f3c7fb2b-ce85-411e-b098-4f8af7b914c9","Type":"ContainerStarted","Data":"2d47e84c3a865db5903cdbd02a7797c3ae7b1efe840b0b9f55b17bb1e9e22d1b"} May 21 02:12:13.193092 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:13.192812 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:13.212333 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:13.212281 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" podStartSLOduration=1.663932124 podStartE2EDuration="4.212266833s" podCreationTimestamp="2026-05-21 02:12:09 +0000 UTC" firstStartedPulling="2026-05-21 02:12:10.019436357 +0000 UTC m=+425.640378307" lastFinishedPulling="2026-05-21 02:12:12.567771066 +0000 UTC m=+428.188713016" observedRunningTime="2026-05-21 02:12:13.210260843 +0000 UTC m=+428.831202812" watchObservedRunningTime="2026-05-21 02:12:13.212266833 +0000 UTC m=+428.833208802" May 21 02:12:24.198190 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:24.198093 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-2mkvp" May 21 02:12:29.745872 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.745838 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2ttpz"] May 21 02:12:29.750983 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.750948 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:29.753445 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.753421 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 02:12:29.753445 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.753439 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m8fbj\"" May 21 02:12:29.760585 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.760565 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2ttpz"] May 21 02:12:29.807098 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.807075 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:29.807200 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.807116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9pj\" (UniqueName: \"kubernetes.io/projected/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-kube-api-access-jc9pj\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:29.907616 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.907589 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:29.907732 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.907630 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9pj\" (UniqueName: \"kubernetes.io/projected/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-kube-api-access-jc9pj\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:29.907777 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:29.907754 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 02:12:29.907837 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:29.907825 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert podName:2e3c5227-cb2d-4b48-9736-d5630a4de0e7 nodeName:}" failed. No retries permitted until 2026-05-21 02:12:30.407806447 +0000 UTC m=+446.028748395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert") pod "odh-model-controller-858dbf95b8-2ttpz" (UID: "2e3c5227-cb2d-4b48-9736-d5630a4de0e7") : secret "odh-model-controller-webhook-cert" not found May 21 02:12:29.917798 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:29.917772 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9pj\" (UniqueName: \"kubernetes.io/projected/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-kube-api-access-jc9pj\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:30.410319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:30.410287 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:30.410523 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:30.410439 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 02:12:30.410523 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:30.410512 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert podName:2e3c5227-cb2d-4b48-9736-d5630a4de0e7 nodeName:}" failed. No retries permitted until 2026-05-21 02:12:31.410495183 +0000 UTC m=+447.031437135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert") pod "odh-model-controller-858dbf95b8-2ttpz" (UID: "2e3c5227-cb2d-4b48-9736-d5630a4de0e7") : secret "odh-model-controller-webhook-cert" not found May 21 02:12:31.417810 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:31.417780 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:31.422131 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:31.421197 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3c5227-cb2d-4b48-9736-d5630a4de0e7-cert\") pod \"odh-model-controller-858dbf95b8-2ttpz\" (UID: \"2e3c5227-cb2d-4b48-9736-d5630a4de0e7\") " pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:31.562062 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:31.562036 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:31.679194 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:31.679131 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2ttpz"] May 21 02:12:31.682254 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:12:31.682226 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3c5227_cb2d_4b48_9736_d5630a4de0e7.slice/crio-3056c7c512a19c6ec1be2cd97083e89434d9a6ab9da02a5b87002aa14ca3fe6c WatchSource:0}: Error finding container 3056c7c512a19c6ec1be2cd97083e89434d9a6ab9da02a5b87002aa14ca3fe6c: Status 404 returned error can't find the container with id 3056c7c512a19c6ec1be2cd97083e89434d9a6ab9da02a5b87002aa14ca3fe6c May 21 02:12:32.245207 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:32.245167 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" event={"ID":"2e3c5227-cb2d-4b48-9736-d5630a4de0e7","Type":"ContainerStarted","Data":"3056c7c512a19c6ec1be2cd97083e89434d9a6ab9da02a5b87002aa14ca3fe6c"} May 21 02:12:34.666389 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.666321 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pw74l"] May 21 02:12:34.669290 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.669272 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:34.671927 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.671906 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tb86l\"" May 21 02:12:34.672056 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.671924 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 02:12:34.677768 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.677707 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pw74l"] May 21 02:12:34.743123 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.743100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlgw\" (UniqueName: \"kubernetes.io/projected/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-kube-api-access-wqlgw\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:34.743234 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.743145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:34.843751 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.843724 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlgw\" (UniqueName: \"kubernetes.io/projected/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-kube-api-access-wqlgw\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:34.843857 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.843760 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:34.843897 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:34.843863 2552 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 02:12:34.843930 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:34.843919 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert podName:c3201cf8-a92f-4ea4-9782-a67dee1a8a44 nodeName:}" failed. No retries permitted until 2026-05-21 02:12:35.343901179 +0000 UTC m=+450.964843127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert") pod "kserve-controller-manager-856948b99f-pw74l" (UID: "c3201cf8-a92f-4ea4-9782-a67dee1a8a44") : secret "kserve-webhook-server-cert" not found May 21 02:12:34.855838 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:34.855816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlgw\" (UniqueName: \"kubernetes.io/projected/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-kube-api-access-wqlgw\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:35.254742 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:35.254709 2552 generic.go:358] "Generic (PLEG): container finished" podID="2e3c5227-cb2d-4b48-9736-d5630a4de0e7" containerID="c6108481b6ab6db8c1ad8642be8203a7ef71bf4f4364156709671e8e9dbee26f" exitCode=1 May 21 02:12:35.254915 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:35.254798 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" event={"ID":"2e3c5227-cb2d-4b48-9736-d5630a4de0e7","Type":"ContainerDied","Data":"c6108481b6ab6db8c1ad8642be8203a7ef71bf4f4364156709671e8e9dbee26f"} May 21 02:12:35.255008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:35.254995 2552 scope.go:117] "RemoveContainer" containerID="c6108481b6ab6db8c1ad8642be8203a7ef71bf4f4364156709671e8e9dbee26f" May 21 02:12:35.347133 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:35.347110 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:35.347255 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:35.347239 2552 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 02:12:35.347320 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:12:35.347309 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert podName:c3201cf8-a92f-4ea4-9782-a67dee1a8a44 nodeName:}" failed. No retries permitted until 2026-05-21 02:12:36.347290131 +0000 UTC m=+451.968232085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert") pod "kserve-controller-manager-856948b99f-pw74l" (UID: "c3201cf8-a92f-4ea4-9782-a67dee1a8a44") : secret "kserve-webhook-server-cert" not found May 21 02:12:36.259255 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.259218 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" event={"ID":"2e3c5227-cb2d-4b48-9736-d5630a4de0e7","Type":"ContainerStarted","Data":"8a0dd0d248b7835e764efbd15e7e42b0843ab9ff7cc9ebecd324f3d2a22a48c4"} May 21 02:12:36.259650 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.259313 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:36.302474 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.302412 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" podStartSLOduration=3.388077393 podStartE2EDuration="7.302394912s" podCreationTimestamp="2026-05-21 02:12:29 +0000 UTC" firstStartedPulling="2026-05-21 02:12:31.683852959 +0000 UTC m=+447.304794910" lastFinishedPulling="2026-05-21 02:12:35.598170473 +0000 UTC m=+451.219112429" observedRunningTime="2026-05-21 02:12:36.30105926 +0000 UTC m=+451.922001241" watchObservedRunningTime="2026-05-21 02:12:36.302394912 +0000 UTC m=+451.923336880" May 21 02:12:36.355182 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.355157 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:36.357551 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.357524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3201cf8-a92f-4ea4-9782-a67dee1a8a44-cert\") pod \"kserve-controller-manager-856948b99f-pw74l\" (UID: \"c3201cf8-a92f-4ea4-9782-a67dee1a8a44\") " pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:36.481633 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.481612 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:36.607462 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:36.607329 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pw74l"] May 21 02:12:36.609735 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:12:36.609707 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3201cf8_a92f_4ea4_9782_a67dee1a8a44.slice/crio-ebf68ff4ef76438d674ac93fdaafd7c7d9f2f157db85a86dfc5cd710b4995d3f WatchSource:0}: Error finding container ebf68ff4ef76438d674ac93fdaafd7c7d9f2f157db85a86dfc5cd710b4995d3f: Status 404 returned error can't find the container with id ebf68ff4ef76438d674ac93fdaafd7c7d9f2f157db85a86dfc5cd710b4995d3f May 21 02:12:37.262830 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.262795 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" event={"ID":"c3201cf8-a92f-4ea4-9782-a67dee1a8a44","Type":"ContainerStarted","Data":"ebf68ff4ef76438d674ac93fdaafd7c7d9f2f157db85a86dfc5cd710b4995d3f"} May 21 02:12:37.658551 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.658518 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92"] May 21 02:12:37.661595 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.661573 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.664216 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.664194 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xms9f\"" May 21 02:12:37.664335 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.664196 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 02:12:37.664335 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.664310 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 02:12:37.664439 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.664426 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 02:12:37.665636 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.665623 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 02:12:37.671218 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.671200 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92"] May 21 02:12:37.763195 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.763171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9lq\" (UniqueName: \"kubernetes.io/projected/c57d306a-a067-4c7a-b648-8e0c8d915ecc-kube-api-access-jw9lq\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.763292 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.763200 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tls-certs\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.763292 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.763225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tmp\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.864291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.864261 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9lq\" (UniqueName: \"kubernetes.io/projected/c57d306a-a067-4c7a-b648-8e0c8d915ecc-kube-api-access-jw9lq\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.864405 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.864303 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tls-certs\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.864405 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.864341 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tmp\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.866711 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.866687 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tmp\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.866937 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.866911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d306a-a067-4c7a-b648-8e0c8d915ecc-tls-certs\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.871599 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.871577 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9lq\" (UniqueName: \"kubernetes.io/projected/c57d306a-a067-4c7a-b648-8e0c8d915ecc-kube-api-access-jw9lq\") pod \"kube-auth-proxy-5cfbc4f554-vcm92\" (UID: \"c57d306a-a067-4c7a-b648-8e0c8d915ecc\") " pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:37.971414 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:37.971357 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" May 21 02:12:38.117021 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:38.116995 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92"] May 21 02:12:38.119673 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:12:38.119638 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57d306a_a067_4c7a_b648_8e0c8d915ecc.slice/crio-ea1857e9286adaaa5c0d16107b0b2f7ba9bb26fb081e151debae79ab75beecd1 WatchSource:0}: Error finding container ea1857e9286adaaa5c0d16107b0b2f7ba9bb26fb081e151debae79ab75beecd1: Status 404 returned error can't find the container with id ea1857e9286adaaa5c0d16107b0b2f7ba9bb26fb081e151debae79ab75beecd1 May 21 02:12:38.267148 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:38.267073 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" event={"ID":"c57d306a-a067-4c7a-b648-8e0c8d915ecc","Type":"ContainerStarted","Data":"ea1857e9286adaaa5c0d16107b0b2f7ba9bb26fb081e151debae79ab75beecd1"} May 21 02:12:41.282257 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:41.282209 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" event={"ID":"c3201cf8-a92f-4ea4-9782-a67dee1a8a44","Type":"ContainerStarted","Data":"bc6df1a506825f4a063227fdd7ac4de0905ca995ea7ed5f599c33b944ae82639"} May 21 02:12:41.282685 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:41.282425 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:12:41.298786 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:41.298748 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" podStartSLOduration=3.342326386 podStartE2EDuration="7.298736734s" podCreationTimestamp="2026-05-21 02:12:34 +0000 UTC" firstStartedPulling="2026-05-21 02:12:36.61120641 +0000 UTC m=+452.232148358" lastFinishedPulling="2026-05-21 02:12:40.567616754 +0000 UTC m=+456.188558706" observedRunningTime="2026-05-21 02:12:41.296718499 +0000 UTC m=+456.917660472" watchObservedRunningTime="2026-05-21 02:12:41.298736734 +0000 UTC m=+456.919678703" May 21 02:12:42.285944 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:42.285908 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" event={"ID":"c57d306a-a067-4c7a-b648-8e0c8d915ecc","Type":"ContainerStarted","Data":"892a9e5847b04852b4c044e2f3894d1412a1cba60d04b3dff87877dc96b70f3f"} May 21 02:12:42.302288 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:42.302241 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cfbc4f554-vcm92" podStartSLOduration=1.935453901 podStartE2EDuration="5.302224506s" podCreationTimestamp="2026-05-21 02:12:37 +0000 UTC" firstStartedPulling="2026-05-21 02:12:38.121813784 +0000 UTC m=+453.742755731" lastFinishedPulling="2026-05-21 02:12:41.488584379 +0000 UTC m=+457.109526336" observedRunningTime="2026-05-21 02:12:42.301317483 +0000 UTC m=+457.922259451" watchObservedRunningTime="2026-05-21 02:12:42.302224506 +0000 UTC m=+457.923166478" May 21 02:12:47.265445 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:47.265412 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-2ttpz" May 21 02:12:52.954303 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.954271 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t"] May 21 02:12:52.962516 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.962500 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:52.965106 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.965071 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 02:12:52.965106 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.965097 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 02:12:52.965291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.965187 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-5grmc\"" May 21 02:12:52.971813 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:52.971516 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t"] May 21 02:12:53.077089 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.077064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbc9h\" (UniqueName: \"kubernetes.io/projected/2916c22f-d651-4989-b807-7d1e0afaedee-kube-api-access-wbc9h\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.077202 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.077099 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2916c22f-d651-4989-b807-7d1e0afaedee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.177911 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.177874 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbc9h\" (UniqueName: \"kubernetes.io/projected/2916c22f-d651-4989-b807-7d1e0afaedee-kube-api-access-wbc9h\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.177911 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.177916 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2916c22f-d651-4989-b807-7d1e0afaedee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.180348 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.180330 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2916c22f-d651-4989-b807-7d1e0afaedee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.188910 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.188892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbc9h\" (UniqueName: \"kubernetes.io/projected/2916c22f-d651-4989-b807-7d1e0afaedee-kube-api-access-wbc9h\") pod \"servicemesh-operator3-55f49c5f94-r5b8t\" (UID: \"2916c22f-d651-4989-b807-7d1e0afaedee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.272133 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.272096 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:53.402417 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:53.402390 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t"] May 21 02:12:53.405804 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:12:53.405773 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2916c22f_d651_4989_b807_7d1e0afaedee.slice/crio-b8ca2ea948cd7d0268bbc01c6bea8f631bc4b0211e077e49fabfcd37fdac387a WatchSource:0}: Error finding container b8ca2ea948cd7d0268bbc01c6bea8f631bc4b0211e077e49fabfcd37fdac387a: Status 404 returned error can't find the container with id b8ca2ea948cd7d0268bbc01c6bea8f631bc4b0211e077e49fabfcd37fdac387a May 21 02:12:54.320828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:54.320785 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" event={"ID":"2916c22f-d651-4989-b807-7d1e0afaedee","Type":"ContainerStarted","Data":"b8ca2ea948cd7d0268bbc01c6bea8f631bc4b0211e077e49fabfcd37fdac387a"} May 21 02:12:56.330749 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:56.330710 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" event={"ID":"2916c22f-d651-4989-b807-7d1e0afaedee","Type":"ContainerStarted","Data":"74ad71fe334fafc62dc7c574ba98b014b817fa90e28f97b27de8e47ddfb40144"} May 21 02:12:56.331479 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:56.331443 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:12:56.354902 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:12:56.354803 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" podStartSLOduration=1.6736251260000001 podStartE2EDuration="4.354782611s" podCreationTimestamp="2026-05-21 02:12:52 +0000 UTC" firstStartedPulling="2026-05-21 02:12:53.408245371 +0000 UTC m=+469.029187322" lastFinishedPulling="2026-05-21 02:12:56.089402859 +0000 UTC m=+471.710344807" observedRunningTime="2026-05-21 02:12:56.353007124 +0000 UTC m=+471.973949091" watchObservedRunningTime="2026-05-21 02:12:56.354782611 +0000 UTC m=+471.975724581" May 21 02:13:08.339716 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.339686 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r5b8t" May 21 02:13:08.386498 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.386464 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr"] May 21 02:13:08.400613 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.400588 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr"] May 21 02:13:08.401383 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.401327 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.404251 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.404233 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2jhxn\"" May 21 02:13:08.404463 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.404441 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 02:13:08.404651 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.404632 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 02:13:08.404794 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.404773 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 02:13:08.407328 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.407306 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 02:13:08.484983 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.484938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485107 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.484989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485107 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.485013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485221 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.485107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485221 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.485196 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.485224 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.485319 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.485295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrg9\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-kube-api-access-wvrg9\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.585826 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.585795 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.585932 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.585853 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.585932 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.585900 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.585932 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.585925 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.586103 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.585985 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrg9\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-kube-api-access-wvrg9\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.586103 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.586036 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.586457 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.586180 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.586587 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.586562 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.588488 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.588458 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.588597 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.588528 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.588702 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.588683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.588857 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.588835 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.594045 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.593954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrg9\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-kube-api-access-wvrg9\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.594180 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.594159 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a056206b-8e8d-45c4-ac8f-cbd2590aedc7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dwftr\" (UID: \"a056206b-8e8d-45c4-ac8f-cbd2590aedc7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.717355 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.717328 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:08.858702 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:08.858670 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr"] May 21 02:13:08.859815 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:13:08.859785 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda056206b_8e8d_45c4_ac8f_cbd2590aedc7.slice/crio-ee9f5f0365660f5da945466fe4cdccef52ee9b7754c3c5e97a23a85663537a39 WatchSource:0}: Error finding container ee9f5f0365660f5da945466fe4cdccef52ee9b7754c3c5e97a23a85663537a39: Status 404 returned error can't find the container with id ee9f5f0365660f5da945466fe4cdccef52ee9b7754c3c5e97a23a85663537a39 May 21 02:13:09.371771 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:09.371738 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" event={"ID":"a056206b-8e8d-45c4-ac8f-cbd2590aedc7","Type":"ContainerStarted","Data":"ee9f5f0365660f5da945466fe4cdccef52ee9b7754c3c5e97a23a85663537a39"} May 21 02:13:11.273871 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:11.273834 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 02:13:11.274158 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:11.273904 2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 02:13:11.381300 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:11.381251 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" event={"ID":"a056206b-8e8d-45c4-ac8f-cbd2590aedc7","Type":"ContainerStarted","Data":"59b6117caba363d6c0c068eb34b231a0e270d58398adba0279aac6c8d97e21b7"} May 21 02:13:11.381600 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:11.381565 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:13:11.402205 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:11.402163 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" podStartSLOduration=0.990451045 podStartE2EDuration="3.40214789s" podCreationTimestamp="2026-05-21 02:13:08 +0000 UTC" firstStartedPulling="2026-05-21 02:13:08.861918443 +0000 UTC m=+484.482860394" lastFinishedPulling="2026-05-21 02:13:11.273615288 +0000 UTC m=+486.894557239" observedRunningTime="2026-05-21 02:13:11.399684962 +0000 UTC m=+487.020626938" watchObservedRunningTime="2026-05-21 02:13:11.40214789 +0000 UTC m=+487.023089851" May 21 02:13:12.293539 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:12.293512 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-pw74l" May 21 02:13:12.391212 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:13:12.391182 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dwftr" May 21 02:14:03.898571 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.898478 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9"] May 21 02:14:03.901672 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.901653 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:03.904339 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.904320 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pb52c\"" May 21 02:14:03.904441 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.904348 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 02:14:03.904441 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.904384 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 02:14:03.911640 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.911620 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9"] May 21 02:14:03.966797 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.966764 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4cjq\" (UniqueName: \"kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:03.966926 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:03.966803 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.067507 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.067478 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4cjq\" (UniqueName: \"kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.067646 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.067518 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.067851 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.067832 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.075455 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.075437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4cjq\" (UniqueName: \"kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.212105 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.212018 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:04.347758 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.347711 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9"] May 21 02:14:04.353680 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:14:04.353650 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5883458_49d3_4195_96ae_bdefd75448e3.slice/crio-c5eb60eaf5c00b8e8deaf93c54f0b02260f65bd99e235e23f2dfa3a75de2294e WatchSource:0}: Error finding container c5eb60eaf5c00b8e8deaf93c54f0b02260f65bd99e235e23f2dfa3a75de2294e: Status 404 returned error can't find the container with id c5eb60eaf5c00b8e8deaf93c54f0b02260f65bd99e235e23f2dfa3a75de2294e May 21 02:14:04.551552 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:04.551518 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" event={"ID":"f5883458-49d3-4195-96ae-bdefd75448e3","Type":"ContainerStarted","Data":"c5eb60eaf5c00b8e8deaf93c54f0b02260f65bd99e235e23f2dfa3a75de2294e"} May 21 02:14:10.572753 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:10.572716 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" event={"ID":"f5883458-49d3-4195-96ae-bdefd75448e3","Type":"ContainerStarted","Data":"683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0"} May 21 02:14:10.573138 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:10.572836 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:10.595413 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:10.595366 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" podStartSLOduration=2.390234544 podStartE2EDuration="7.595352434s" podCreationTimestamp="2026-05-21 02:14:03 +0000 UTC" firstStartedPulling="2026-05-21 02:14:04.355895499 +0000 UTC m=+539.976837452" lastFinishedPulling="2026-05-21 02:14:09.561013381 +0000 UTC m=+545.181955342" observedRunningTime="2026-05-21 02:14:10.593513973 +0000 UTC m=+546.214455944" watchObservedRunningTime="2026-05-21 02:14:10.595352434 +0000 UTC m=+546.216294471" May 21 02:14:21.578419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:21.578383 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:23.346722 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.346682 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9"] May 21 02:14:23.347235 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.346993 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" containerName="manager" containerID="cri-o://683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0" gracePeriod=2 May 21 02:14:23.350450 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.350386 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:23.350611 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.350533 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9"] May 21 02:14:23.371076 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.371048 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:23.371477 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.371461 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" containerName="manager" May 21 02:14:23.371522 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.371480 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" containerName="manager" May 21 02:14:23.371570 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.371552 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" containerName="manager" May 21 02:14:23.374551 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.374531 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.378801 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.378771 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:23.392724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.392702 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:23.455099 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.455075 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:14:23.458224 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.458207 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.460493 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.460462 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:23.467287 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.467272 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:14:23.513652 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.513618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.513811 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.513669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn56h\" (UniqueName: \"kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.513811 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.513719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.513811 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.513766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqwq\" (UniqueName: \"kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.577945 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.577923 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:23.580248 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.580221 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:23.614179 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614113 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqwq\" (UniqueName: \"kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.614295 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614225 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.614295 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614259 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn56h\" (UniqueName: \"kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.614400 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614293 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.614615 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614582 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.614615 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614610 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.614888 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614868 2552 generic.go:358] "Generic (PLEG): container finished" podID="f5883458-49d3-4195-96ae-bdefd75448e3" containerID="683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0" exitCode=0 May 21 02:14:23.614930 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614913 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" May 21 02:14:23.614930 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.614923 2552 scope.go:117] "RemoveContainer" containerID="683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0" May 21 02:14:23.617125 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.617095 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:23.623284 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.623264 2552 scope.go:117] "RemoveContainer" containerID="683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0" May 21 02:14:23.623499 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.623478 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqwq\" (UniqueName: \"kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qxhcf\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.623584 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.623526 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn56h\" (UniqueName: \"kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-td5dh\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.623584 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:14:23.623554 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0\": container with ID starting with 683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0 not found: ID does not exist" containerID="683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0" May 21 02:14:23.623693 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.623580 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0"} err="failed to get container status \"683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0\": rpc error: code = NotFound desc = could not find container \"683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0\": container with ID starting with 683ad8a811f297667ac2acb5352ddee4381300099c23dc46213047fb3069f9c0 not found: ID does not exist" May 21 02:14:23.714896 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.714874 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4cjq\" (UniqueName: \"kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq\") pod \"f5883458-49d3-4195-96ae-bdefd75448e3\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " May 21 02:14:23.715020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.714909 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume\") pod \"f5883458-49d3-4195-96ae-bdefd75448e3\" (UID: \"f5883458-49d3-4195-96ae-bdefd75448e3\") " May 21 02:14:23.715414 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.715392 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f5883458-49d3-4195-96ae-bdefd75448e3" (UID: "f5883458-49d3-4195-96ae-bdefd75448e3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:14:23.716724 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.716706 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq" (OuterVolumeSpecName: "kube-api-access-b4cjq") pod "f5883458-49d3-4195-96ae-bdefd75448e3" (UID: "f5883458-49d3-4195-96ae-bdefd75448e3"). InnerVolumeSpecName "kube-api-access-b4cjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:14:23.732876 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.732859 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:23.768499 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.768472 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:23.815835 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.815766 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5883458-49d3-4195-96ae-bdefd75448e3-extensions-socket-volume\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:14:23.815835 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.815804 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4cjq\" (UniqueName: \"kubernetes.io/projected/f5883458-49d3-4195-96ae-bdefd75448e3-kube-api-access-b4cjq\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:14:23.868022 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.867945 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:23.871497 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:14:23.871466 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3898eeb_48ae_4196_a6c7_f9dcd0de582b.slice/crio-402ea7ac94156b2bb2810ba27eff987809b4af44d9e5641604a802a65b3bd1cb WatchSource:0}: Error finding container 402ea7ac94156b2bb2810ba27eff987809b4af44d9e5641604a802a65b3bd1cb: Status 404 returned error can't find the container with id 402ea7ac94156b2bb2810ba27eff987809b4af44d9e5641604a802a65b3bd1cb May 21 02:14:23.898354 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.898331 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:14:23.914104 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:14:23.914077 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee1b386_d3d7_4139_b7f8_010ba94b207e.slice/crio-f89669adcd97bd5d2c8f4c11f3aeaeda17313dfbf924e787498eeff322fb4792 WatchSource:0}: Error finding container f89669adcd97bd5d2c8f4c11f3aeaeda17313dfbf924e787498eeff322fb4792: Status 404 returned error can't find the container with id f89669adcd97bd5d2c8f4c11f3aeaeda17313dfbf924e787498eeff322fb4792 May 21 02:14:23.935511 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:23.935486 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:24.619264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.619177 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" event={"ID":"eee1b386-d3d7-4139-b7f8-010ba94b207e","Type":"ContainerStarted","Data":"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0"} May 21 02:14:24.619264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.619218 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" event={"ID":"eee1b386-d3d7-4139-b7f8-010ba94b207e","Type":"ContainerStarted","Data":"f89669adcd97bd5d2c8f4c11f3aeaeda17313dfbf924e787498eeff322fb4792"} May 21 02:14:24.619264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.619258 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:24.620623 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.620596 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" event={"ID":"f3898eeb-48ae-4196-a6c7-f9dcd0de582b","Type":"ContainerStarted","Data":"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477"} May 21 02:14:24.620750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.620628 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" event={"ID":"f3898eeb-48ae-4196-a6c7-f9dcd0de582b","Type":"ContainerStarted","Data":"402ea7ac94156b2bb2810ba27eff987809b4af44d9e5641604a802a65b3bd1cb"} May 21 02:14:24.620750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.620655 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:24.621670 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.621646 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:24.645494 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.645447 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" podStartSLOduration=1.6454362580000002 podStartE2EDuration="1.645436258s" podCreationTimestamp="2026-05-21 02:14:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:14:24.644435046 +0000 UTC m=+560.265377027" watchObservedRunningTime="2026-05-21 02:14:24.645436258 +0000 UTC m=+560.266378227" May 21 02:14:24.646649 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.646624 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:24.664407 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.664373 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" podStartSLOduration=1.664361971 podStartE2EDuration="1.664361971s" podCreationTimestamp="2026-05-21 02:14:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:14:24.663831584 +0000 UTC m=+560.284773555" watchObservedRunningTime="2026-05-21 02:14:24.664361971 +0000 UTC m=+560.285303982" May 21 02:14:24.952839 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.952743 2552 status_manager.go:895] "Failed to get status for pod" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vzxz9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vzxz9\" is forbidden: User \"system:node:ip-10-0-130-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-115.ec2.internal' and this object" May 21 02:14:24.953486 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:24.953462 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5883458-49d3-4195-96ae-bdefd75448e3" path="/var/lib/kubelet/pods/f5883458-49d3-4195-96ae-bdefd75448e3/volumes" May 21 02:14:35.627174 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:35.627141 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:14:35.627729 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:35.627482 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:35.694286 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:35.694260 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:35.694465 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:35.694445 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" podUID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" containerName="manager" containerID="cri-o://0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477" gracePeriod=10 May 21 02:14:35.948172 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:35.948152 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:36.007117 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.007090 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn56h\" (UniqueName: \"kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h\") pod \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " May 21 02:14:36.007263 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.007178 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume\") pod \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\" (UID: \"f3898eeb-48ae-4196-a6c7-f9dcd0de582b\") " May 21 02:14:36.007533 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.007509 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3898eeb-48ae-4196-a6c7-f9dcd0de582b" (UID: "f3898eeb-48ae-4196-a6c7-f9dcd0de582b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:14:36.008935 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.008915 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h" (OuterVolumeSpecName: "kube-api-access-jn56h") pod "f3898eeb-48ae-4196-a6c7-f9dcd0de582b" (UID: "f3898eeb-48ae-4196-a6c7-f9dcd0de582b"). InnerVolumeSpecName "kube-api-access-jn56h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:14:36.108056 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.108028 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-extensions-socket-volume\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:14:36.108056 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.108052 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn56h\" (UniqueName: \"kubernetes.io/projected/f3898eeb-48ae-4196-a6c7-f9dcd0de582b-kube-api-access-jn56h\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:14:36.663221 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.663188 2552 generic.go:358] "Generic (PLEG): container finished" podID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" containerID="0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477" exitCode=0 May 21 02:14:36.663606 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.663250 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" May 21 02:14:36.663606 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.663270 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" event={"ID":"f3898eeb-48ae-4196-a6c7-f9dcd0de582b","Type":"ContainerDied","Data":"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477"} May 21 02:14:36.663606 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.663296 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh" event={"ID":"f3898eeb-48ae-4196-a6c7-f9dcd0de582b","Type":"ContainerDied","Data":"402ea7ac94156b2bb2810ba27eff987809b4af44d9e5641604a802a65b3bd1cb"} May 21 02:14:36.663606 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.663310 2552 scope.go:117] "RemoveContainer" containerID="0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477" May 21 02:14:36.670855 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.670835 2552 scope.go:117] "RemoveContainer" containerID="0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477" May 21 02:14:36.671134 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:14:36.671116 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477\": container with ID starting with 0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477 not found: ID does not exist" containerID="0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477" May 21 02:14:36.671196 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.671143 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477"} err="failed to get container status \"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477\": rpc error: code = NotFound desc = could not find container \"0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477\": container with ID starting with 0760c5078f84e6fed98fc436056ad4aef840f49f39f3327112b2036b66101477 not found: ID does not exist" May 21 02:14:36.688986 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.685994 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:36.693323 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.693300 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-td5dh"] May 21 02:14:36.955300 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:36.955214 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" path="/var/lib/kubelet/pods/f3898eeb-48ae-4196-a6c7-f9dcd0de582b/volumes" May 21 02:14:55.960200 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.960172 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:14:55.960601 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.960422 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" containerName="manager" May 21 02:14:55.960601 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.960433 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" containerName="manager" May 21 02:14:55.960601 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.960504 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3898eeb-48ae-4196-a6c7-f9dcd0de582b" containerName="manager" May 21 02:14:55.963165 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.963148 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:55.965827 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.965804 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 02:14:55.965927 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.965835 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m872m\"" May 21 02:14:55.973909 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:55.973888 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:14:56.047333 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.047306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.047594 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.047547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v752\" (UniqueName: \"kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.055828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.055808 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:14:56.148314 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.148293 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v752\" (UniqueName: \"kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.148429 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.148325 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.148900 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.148879 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.155899 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.155875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v752\" (UniqueName: \"kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752\") pod \"limitador-limitador-7d549b5b-g7b6r\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.272823 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.272796 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:56.403273 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.403249 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:14:56.406164 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:14:56.406136 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbdb819_b6ab_4a51_8755_1304edf797b0.slice/crio-1ab3b5cf177c2249d0dc0b4c2dcb6e48ced751d8dd3ed44cccf36aab411addbf WatchSource:0}: Error finding container 1ab3b5cf177c2249d0dc0b4c2dcb6e48ced751d8dd3ed44cccf36aab411addbf: Status 404 returned error can't find the container with id 1ab3b5cf177c2249d0dc0b4c2dcb6e48ced751d8dd3ed44cccf36aab411addbf May 21 02:14:56.726386 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:56.726314 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" event={"ID":"1cbdb819-b6ab-4a51-8755-1304edf797b0","Type":"ContainerStarted","Data":"1ab3b5cf177c2249d0dc0b4c2dcb6e48ced751d8dd3ed44cccf36aab411addbf"} May 21 02:14:59.740552 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:59.740457 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" event={"ID":"1cbdb819-b6ab-4a51-8755-1304edf797b0","Type":"ContainerStarted","Data":"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d"} May 21 02:14:59.740552 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:59.740522 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:14:59.755695 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:14:59.755651 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" podStartSLOduration=1.87573502 podStartE2EDuration="4.755638698s" podCreationTimestamp="2026-05-21 02:14:55 +0000 UTC" firstStartedPulling="2026-05-21 02:14:56.407804863 +0000 UTC m=+592.028746810" lastFinishedPulling="2026-05-21 02:14:59.287708542 +0000 UTC m=+594.908650488" observedRunningTime="2026-05-21 02:14:59.755067997 +0000 UTC m=+595.376009967" watchObservedRunningTime="2026-05-21 02:14:59.755638698 +0000 UTC m=+595.376580666" May 21 02:15:04.922002 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:04.921976 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:15:04.922786 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:04.922763 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:15:10.745596 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:10.745557 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:15:11.583810 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:11.583780 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:15:11.584004 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:11.583983 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" podUID="1cbdb819-b6ab-4a51-8755-1304edf797b0" containerName="limitador" containerID="cri-o://29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d" gracePeriod=30 May 21 02:15:12.517568 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.517542 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:15:12.666127 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.666070 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v752\" (UniqueName: \"kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752\") pod \"1cbdb819-b6ab-4a51-8755-1304edf797b0\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " May 21 02:15:12.666237 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.666129 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file\") pod \"1cbdb819-b6ab-4a51-8755-1304edf797b0\" (UID: \"1cbdb819-b6ab-4a51-8755-1304edf797b0\") " May 21 02:15:12.666414 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.666391 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file" (OuterVolumeSpecName: "config-file") pod "1cbdb819-b6ab-4a51-8755-1304edf797b0" (UID: "1cbdb819-b6ab-4a51-8755-1304edf797b0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:15:12.667996 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.667948 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752" (OuterVolumeSpecName: "kube-api-access-7v752") pod "1cbdb819-b6ab-4a51-8755-1304edf797b0" (UID: "1cbdb819-b6ab-4a51-8755-1304edf797b0"). InnerVolumeSpecName "kube-api-access-7v752". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:12.767102 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.767078 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v752\" (UniqueName: \"kubernetes.io/projected/1cbdb819-b6ab-4a51-8755-1304edf797b0-kube-api-access-7v752\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:15:12.767102 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.767100 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbdb819-b6ab-4a51-8755-1304edf797b0-config-file\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:15:12.782798 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.782771 2552 generic.go:358] "Generic (PLEG): container finished" podID="1cbdb819-b6ab-4a51-8755-1304edf797b0" containerID="29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d" exitCode=0 May 21 02:15:12.782906 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.782804 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" event={"ID":"1cbdb819-b6ab-4a51-8755-1304edf797b0","Type":"ContainerDied","Data":"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d"} May 21 02:15:12.782906 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.782828 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" event={"ID":"1cbdb819-b6ab-4a51-8755-1304edf797b0","Type":"ContainerDied","Data":"1ab3b5cf177c2249d0dc0b4c2dcb6e48ced751d8dd3ed44cccf36aab411addbf"} May 21 02:15:12.782906 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.782832 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g7b6r" May 21 02:15:12.782906 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.782860 2552 scope.go:117] "RemoveContainer" containerID="29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d" May 21 02:15:12.791462 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.791412 2552 scope.go:117] "RemoveContainer" containerID="29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d" May 21 02:15:12.791723 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:15:12.791705 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d\": container with ID starting with 29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d not found: ID does not exist" containerID="29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d" May 21 02:15:12.791791 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.791730 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d"} err="failed to get container status \"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d\": rpc error: code = NotFound desc = could not find container \"29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d\": container with ID starting with 29df780e6e056897dac924d3cf625ecaf93cac298b13b86f2571246b2ad5004d not found: ID does not exist" May 21 02:15:12.804002 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.803953 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:15:12.807359 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.807337 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g7b6r"] May 21 02:15:12.952750 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:12.952693 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbdb819-b6ab-4a51-8755-1304edf797b0" path="/var/lib/kubelet/pods/1cbdb819-b6ab-4a51-8755-1304edf797b0/volumes" May 21 02:15:16.948216 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.948184 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4bwr6"] May 21 02:15:16.948713 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.948489 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbdb819-b6ab-4a51-8755-1304edf797b0" containerName="limitador" May 21 02:15:16.948713 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.948504 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbdb819-b6ab-4a51-8755-1304edf797b0" containerName="limitador" May 21 02:15:16.948713 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.948570 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cbdb819-b6ab-4a51-8755-1304edf797b0" containerName="limitador" May 21 02:15:16.952982 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.952938 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:16.956291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.956118 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 02:15:16.956487 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.956470 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2r228\"" May 21 02:15:16.961327 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:16.961297 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4bwr6"] May 21 02:15:17.096089 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.096055 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc707458-3fdf-4fd9-8e08-70d644cebc5d-data\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.096235 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.096096 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8lj\" (UniqueName: \"kubernetes.io/projected/fc707458-3fdf-4fd9-8e08-70d644cebc5d-kube-api-access-8b8lj\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.197459 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.197428 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc707458-3fdf-4fd9-8e08-70d644cebc5d-data\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.197571 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.197467 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8lj\" (UniqueName: \"kubernetes.io/projected/fc707458-3fdf-4fd9-8e08-70d644cebc5d-kube-api-access-8b8lj\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.197785 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.197765 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc707458-3fdf-4fd9-8e08-70d644cebc5d-data\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.205822 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.205773 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8lj\" (UniqueName: \"kubernetes.io/projected/fc707458-3fdf-4fd9-8e08-70d644cebc5d-kube-api-access-8b8lj\") pod \"postgres-68c4fbbd6f-4bwr6\" (UID: \"fc707458-3fdf-4fd9-8e08-70d644cebc5d\") " pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.266948 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.266923 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:17.388773 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.388732 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4bwr6"] May 21 02:15:17.397051 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:15:17.397020 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc707458_3fdf_4fd9_8e08_70d644cebc5d.slice/crio-8deadabfaa4c00ba8e5f24da5d38be8e8dfa400426fb7dbcf93d24a6c3d4316c WatchSource:0}: Error finding container 8deadabfaa4c00ba8e5f24da5d38be8e8dfa400426fb7dbcf93d24a6c3d4316c: Status 404 returned error can't find the container with id 8deadabfaa4c00ba8e5f24da5d38be8e8dfa400426fb7dbcf93d24a6c3d4316c May 21 02:15:17.804652 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:17.804614 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" event={"ID":"fc707458-3fdf-4fd9-8e08-70d644cebc5d","Type":"ContainerStarted","Data":"8deadabfaa4c00ba8e5f24da5d38be8e8dfa400426fb7dbcf93d24a6c3d4316c"} May 21 02:15:22.822864 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:22.822827 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" event={"ID":"fc707458-3fdf-4fd9-8e08-70d644cebc5d","Type":"ContainerStarted","Data":"e180a05104e6af94443c708554985c0a30cc87e3ef938b7156b20f749383af54"} May 21 02:15:22.823291 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:22.822950 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:22.838008 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:22.837952 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" podStartSLOduration=2.1711859860000002 podStartE2EDuration="6.837939488s" podCreationTimestamp="2026-05-21 02:15:16 +0000 UTC" firstStartedPulling="2026-05-21 02:15:17.398483633 +0000 UTC m=+613.019425580" lastFinishedPulling="2026-05-21 02:15:22.065237117 +0000 UTC m=+617.686179082" observedRunningTime="2026-05-21 02:15:22.836449439 +0000 UTC m=+618.457391409" watchObservedRunningTime="2026-05-21 02:15:22.837939488 +0000 UTC m=+618.458881456" May 21 02:15:28.854150 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:28.854118 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-4bwr6" May 21 02:15:33.801534 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.801503 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:33.804734 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.804713 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:33.807212 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.807186 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 02:15:33.807330 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.807244 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jfqq7\"" May 21 02:15:33.817742 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.817708 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:33.819271 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.819245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnjf\" (UniqueName: \"kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf\") pod \"maas-controller-68fb5d86bc-5xjh8\" (UID: \"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06\") " pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:33.920009 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.919978 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnjf\" (UniqueName: \"kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf\") pod \"maas-controller-68fb5d86bc-5xjh8\" (UID: \"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06\") " pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:33.931543 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.931514 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnjf\" (UniqueName: \"kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf\") pod \"maas-controller-68fb5d86bc-5xjh8\" (UID: \"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06\") " pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:33.938131 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.938112 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:33.941178 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.941163 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:33.948172 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:33.948154 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:34.021307 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.021278 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbtnt\" (UniqueName: \"kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt\") pod \"maas-controller-f85d894fb-n5xpf\" (UID: \"d1354595-db4f-43b9-aa43-3ffad436cb3e\") " pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:34.048905 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.048880 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:34.049087 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.049075 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:34.074433 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.074410 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:15:34.077869 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.077853 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:34.085582 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.085558 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:15:34.122159 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.121819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl86t\" (UniqueName: \"kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t\") pod \"maas-controller-58789ff8-drpxk\" (UID: \"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa\") " pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:34.122159 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.121855 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbtnt\" (UniqueName: \"kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt\") pod \"maas-controller-f85d894fb-n5xpf\" (UID: \"d1354595-db4f-43b9-aa43-3ffad436cb3e\") " pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:34.131156 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.131129 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbtnt\" (UniqueName: \"kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt\") pod \"maas-controller-f85d894fb-n5xpf\" (UID: \"d1354595-db4f-43b9-aa43-3ffad436cb3e\") " pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:34.178405 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.178384 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:34.180891 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:15:34.180867 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc054a4bb_08f6_40ff_b5bc_b25e0b9cfd06.slice/crio-ffebdf3a62a13a289c4c150666492f0f6c70b23e9f5409468eaca5eca2f7176d WatchSource:0}: Error finding container ffebdf3a62a13a289c4c150666492f0f6c70b23e9f5409468eaca5eca2f7176d: Status 404 returned error can't find the container with id ffebdf3a62a13a289c4c150666492f0f6c70b23e9f5409468eaca5eca2f7176d May 21 02:15:34.223098 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.223076 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl86t\" (UniqueName: \"kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t\") pod \"maas-controller-58789ff8-drpxk\" (UID: \"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa\") " pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:34.230313 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.230290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl86t\" (UniqueName: \"kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t\") pod \"maas-controller-58789ff8-drpxk\" (UID: \"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa\") " pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:34.251033 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.251016 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:34.373908 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.373880 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:34.376189 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:15:34.376163 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1354595_db4f_43b9_aa43_3ffad436cb3e.slice/crio-01d25c68e3226f2b10998bced8132122522c65f0932ecdfe0cbaec89cacc0a0a WatchSource:0}: Error finding container 01d25c68e3226f2b10998bced8132122522c65f0932ecdfe0cbaec89cacc0a0a: Status 404 returned error can't find the container with id 01d25c68e3226f2b10998bced8132122522c65f0932ecdfe0cbaec89cacc0a0a May 21 02:15:34.390084 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.390058 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:34.506568 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.506540 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:15:34.509357 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:15:34.509330 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac03f8c_ba5a_48a2_ab8e_94fe1478cefa.slice/crio-f8c7c4fa08960d023a9693e2ac856a4753cb8f6a36eb47bc18d01e8829a39320 WatchSource:0}: Error finding container f8c7c4fa08960d023a9693e2ac856a4753cb8f6a36eb47bc18d01e8829a39320: Status 404 returned error can't find the container with id f8c7c4fa08960d023a9693e2ac856a4753cb8f6a36eb47bc18d01e8829a39320 May 21 02:15:34.873579 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.873538 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f85d894fb-n5xpf" event={"ID":"d1354595-db4f-43b9-aa43-3ffad436cb3e","Type":"ContainerStarted","Data":"01d25c68e3226f2b10998bced8132122522c65f0932ecdfe0cbaec89cacc0a0a"} May 21 02:15:34.874782 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.874756 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" event={"ID":"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06","Type":"ContainerStarted","Data":"ffebdf3a62a13a289c4c150666492f0f6c70b23e9f5409468eaca5eca2f7176d"} May 21 02:15:34.876134 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:34.876105 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58789ff8-drpxk" event={"ID":"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa","Type":"ContainerStarted","Data":"f8c7c4fa08960d023a9693e2ac856a4753cb8f6a36eb47bc18d01e8829a39320"} May 21 02:15:37.889794 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.889706 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58789ff8-drpxk" event={"ID":"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa","Type":"ContainerStarted","Data":"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8"} May 21 02:15:37.890212 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.889807 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:37.891017 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.890992 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f85d894fb-n5xpf" event={"ID":"d1354595-db4f-43b9-aa43-3ffad436cb3e","Type":"ContainerStarted","Data":"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae"} May 21 02:15:37.891083 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.891041 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:37.892200 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.892175 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" event={"ID":"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06","Type":"ContainerStarted","Data":"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619"} May 21 02:15:37.892293 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.892258 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" podUID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" containerName="manager" containerID="cri-o://d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619" gracePeriod=30 May 21 02:15:37.892332 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.892291 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:37.920402 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.920358 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58789ff8-drpxk" podStartSLOduration=0.803671362 podStartE2EDuration="3.920347123s" podCreationTimestamp="2026-05-21 02:15:34 +0000 UTC" firstStartedPulling="2026-05-21 02:15:34.510634877 +0000 UTC m=+630.131576841" lastFinishedPulling="2026-05-21 02:15:37.627310654 +0000 UTC m=+633.248252602" observedRunningTime="2026-05-21 02:15:37.918952064 +0000 UTC m=+633.539894034" watchObservedRunningTime="2026-05-21 02:15:37.920347123 +0000 UTC m=+633.541289093" May 21 02:15:37.936561 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.936516 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" podStartSLOduration=1.491924469 podStartE2EDuration="4.936505818s" podCreationTimestamp="2026-05-21 02:15:33 +0000 UTC" firstStartedPulling="2026-05-21 02:15:34.182197993 +0000 UTC m=+629.803139940" lastFinishedPulling="2026-05-21 02:15:37.626779328 +0000 UTC m=+633.247721289" observedRunningTime="2026-05-21 02:15:37.935830695 +0000 UTC m=+633.556772665" watchObservedRunningTime="2026-05-21 02:15:37.936505818 +0000 UTC m=+633.557447787" May 21 02:15:37.953358 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:37.953297 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-f85d894fb-n5xpf" podStartSLOduration=1.6939068320000001 podStartE2EDuration="4.953280083s" podCreationTimestamp="2026-05-21 02:15:33 +0000 UTC" firstStartedPulling="2026-05-21 02:15:34.377501652 +0000 UTC m=+629.998443603" lastFinishedPulling="2026-05-21 02:15:37.636874891 +0000 UTC m=+633.257816854" observedRunningTime="2026-05-21 02:15:37.952211268 +0000 UTC m=+633.573153247" watchObservedRunningTime="2026-05-21 02:15:37.953280083 +0000 UTC m=+633.574222052" May 21 02:15:38.130397 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.130365 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:38.158233 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.158180 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmnjf\" (UniqueName: \"kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf\") pod \"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06\" (UID: \"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06\") " May 21 02:15:38.160503 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.160474 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf" (OuterVolumeSpecName: "kube-api-access-jmnjf") pod "c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" (UID: "c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06"). InnerVolumeSpecName "kube-api-access-jmnjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:38.259059 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.259032 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmnjf\" (UniqueName: \"kubernetes.io/projected/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06-kube-api-access-jmnjf\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:15:38.897120 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.897043 2552 generic.go:358] "Generic (PLEG): container finished" podID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" containerID="d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619" exitCode=0 May 21 02:15:38.897120 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.897107 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" May 21 02:15:38.897527 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.897129 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" event={"ID":"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06","Type":"ContainerDied","Data":"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619"} May 21 02:15:38.897527 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.897169 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5xjh8" event={"ID":"c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06","Type":"ContainerDied","Data":"ffebdf3a62a13a289c4c150666492f0f6c70b23e9f5409468eaca5eca2f7176d"} May 21 02:15:38.897527 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.897189 2552 scope.go:117] "RemoveContainer" containerID="d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619" May 21 02:15:38.905985 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.905942 2552 scope.go:117] "RemoveContainer" containerID="d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619" May 21 02:15:38.906246 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:15:38.906228 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619\": container with ID starting with d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619 not found: ID does not exist" containerID="d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619" May 21 02:15:38.906302 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.906256 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619"} err="failed to get container status \"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619\": rpc error: code = NotFound desc = could not find container \"d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619\": container with ID starting with d8e87a46f09e870721978fdbc4d778655211496ad895de024634679e1f059619 not found: ID does not exist" May 21 02:15:38.918252 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.918229 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:38.931692 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.926822 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5xjh8"] May 21 02:15:38.953264 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:38.953232 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" path="/var/lib/kubelet/pods/c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06/volumes" May 21 02:15:48.903338 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:48.903308 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:48.905671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:48.903356 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:15:48.957237 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:48.957185 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:48.957434 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:48.957411 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-f85d894fb-n5xpf" podUID="d1354595-db4f-43b9-aa43-3ffad436cb3e" containerName="manager" containerID="cri-o://ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae" gracePeriod=30 May 21 02:15:49.129934 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.129907 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:15:49.130316 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.130300 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" containerName="manager" May 21 02:15:49.130397 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.130319 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" containerName="manager" May 21 02:15:49.130397 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.130373 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c054a4bb-08f6-40ff-b5bc-b25e0b9cfd06" containerName="manager" May 21 02:15:49.133355 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.133333 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:49.146520 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.146498 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:15:49.195473 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.195452 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:49.234034 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.234010 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbtnt\" (UniqueName: \"kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt\") pod \"d1354595-db4f-43b9-aa43-3ffad436cb3e\" (UID: \"d1354595-db4f-43b9-aa43-3ffad436cb3e\") " May 21 02:15:49.234160 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.234148 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj\") pod \"maas-controller-786cc58767-jhfn6\" (UID: \"592c57fc-872c-4ab8-8dca-693b5c1e3535\") " pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:49.235930 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.235892 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt" (OuterVolumeSpecName: "kube-api-access-bbtnt") pod "d1354595-db4f-43b9-aa43-3ffad436cb3e" (UID: "d1354595-db4f-43b9-aa43-3ffad436cb3e"). InnerVolumeSpecName "kube-api-access-bbtnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:49.334788 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.334764 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj\") pod \"maas-controller-786cc58767-jhfn6\" (UID: \"592c57fc-872c-4ab8-8dca-693b5c1e3535\") " pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:49.334875 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.334803 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbtnt\" (UniqueName: \"kubernetes.io/projected/d1354595-db4f-43b9-aa43-3ffad436cb3e-kube-api-access-bbtnt\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:15:49.342901 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.342875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj\") pod \"maas-controller-786cc58767-jhfn6\" (UID: \"592c57fc-872c-4ab8-8dca-693b5c1e3535\") " pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:49.443701 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.443642 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:49.562950 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.562920 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:15:49.565734 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:15:49.565710 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592c57fc_872c_4ab8_8dca_693b5c1e3535.slice/crio-4283db078af74a0774bf4147b2411c9827382b1d7445ed8554b59728bc4aad31 WatchSource:0}: Error finding container 4283db078af74a0774bf4147b2411c9827382b1d7445ed8554b59728bc4aad31: Status 404 returned error can't find the container with id 4283db078af74a0774bf4147b2411c9827382b1d7445ed8554b59728bc4aad31 May 21 02:15:49.933619 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.933589 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-jhfn6" event={"ID":"592c57fc-872c-4ab8-8dca-693b5c1e3535","Type":"ContainerStarted","Data":"4283db078af74a0774bf4147b2411c9827382b1d7445ed8554b59728bc4aad31"} May 21 02:15:49.934583 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.934561 2552 generic.go:358] "Generic (PLEG): container finished" podID="d1354595-db4f-43b9-aa43-3ffad436cb3e" containerID="ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae" exitCode=0 May 21 02:15:49.934635 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.934618 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f85d894fb-n5xpf" May 21 02:15:49.934635 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.934629 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f85d894fb-n5xpf" event={"ID":"d1354595-db4f-43b9-aa43-3ffad436cb3e","Type":"ContainerDied","Data":"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae"} May 21 02:15:49.934701 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.934653 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f85d894fb-n5xpf" event={"ID":"d1354595-db4f-43b9-aa43-3ffad436cb3e","Type":"ContainerDied","Data":"01d25c68e3226f2b10998bced8132122522c65f0932ecdfe0cbaec89cacc0a0a"} May 21 02:15:49.934701 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.934676 2552 scope.go:117] "RemoveContainer" containerID="ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae" May 21 02:15:49.942448 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.942429 2552 scope.go:117] "RemoveContainer" containerID="ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae" May 21 02:15:49.942714 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:15:49.942697 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae\": container with ID starting with ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae not found: ID does not exist" containerID="ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae" May 21 02:15:49.942767 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.942722 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae"} err="failed to get container status \"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae\": rpc error: code = NotFound desc = could not find container \"ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae\": container with ID starting with ca1880caf57afdec6e22b3c0b74b129957eed42730e9452ae5fa0d2ce7aa19ae not found: ID does not exist" May 21 02:15:49.954927 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.954904 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:49.958865 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:49.958839 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f85d894fb-n5xpf"] May 21 02:15:50.939419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:50.939378 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-jhfn6" event={"ID":"592c57fc-872c-4ab8-8dca-693b5c1e3535","Type":"ContainerStarted","Data":"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d"} May 21 02:15:50.939885 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:50.939544 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:15:50.953487 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:50.953458 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1354595-db4f-43b9-aa43-3ffad436cb3e" path="/var/lib/kubelet/pods/d1354595-db4f-43b9-aa43-3ffad436cb3e/volumes" May 21 02:15:50.954294 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:15:50.954227 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-786cc58767-jhfn6" podStartSLOduration=1.5549455509999999 podStartE2EDuration="1.954212493s" podCreationTimestamp="2026-05-21 02:15:49 +0000 UTC" firstStartedPulling="2026-05-21 02:15:49.567040938 +0000 UTC m=+645.187982889" lastFinishedPulling="2026-05-21 02:15:49.96630788 +0000 UTC m=+645.587249831" observedRunningTime="2026-05-21 02:15:50.954196534 +0000 UTC m=+646.575138502" watchObservedRunningTime="2026-05-21 02:15:50.954212493 +0000 UTC m=+646.575154522" May 21 02:16:01.948809 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:01.948778 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:16:01.987310 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:01.987280 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:16:01.987540 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:01.987514 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-58789ff8-drpxk" podUID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" containerName="manager" containerID="cri-o://56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8" gracePeriod=30 May 21 02:16:02.227405 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.227379 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:16:02.328045 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.327932 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl86t\" (UniqueName: \"kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t\") pod \"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa\" (UID: \"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa\") " May 21 02:16:02.329840 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.329818 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t" (OuterVolumeSpecName: "kube-api-access-zl86t") pod "4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" (UID: "4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa"). InnerVolumeSpecName "kube-api-access-zl86t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:16:02.429493 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.429460 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl86t\" (UniqueName: \"kubernetes.io/projected/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa-kube-api-access-zl86t\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:16:02.982586 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.982547 2552 generic.go:358] "Generic (PLEG): container finished" podID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" containerID="56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8" exitCode=0 May 21 02:16:02.983020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.982612 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58789ff8-drpxk" May 21 02:16:02.983020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.982625 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58789ff8-drpxk" event={"ID":"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa","Type":"ContainerDied","Data":"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8"} May 21 02:16:02.983020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.982672 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58789ff8-drpxk" event={"ID":"4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa","Type":"ContainerDied","Data":"f8c7c4fa08960d023a9693e2ac856a4753cb8f6a36eb47bc18d01e8829a39320"} May 21 02:16:02.983020 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.982697 2552 scope.go:117] "RemoveContainer" containerID="56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8" May 21 02:16:02.991175 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.990996 2552 scope.go:117] "RemoveContainer" containerID="56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8" May 21 02:16:02.991278 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:16:02.991260 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8\": container with ID starting with 56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8 not found: ID does not exist" containerID="56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8" May 21 02:16:02.991336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:02.991298 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8"} err="failed to get container status \"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8\": rpc error: code = NotFound desc = could not find container \"56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8\": container with ID starting with 56389d9c36748236e52bb4b5efe90bdf155bb92e0bf406a8a44f893253959cd8 not found: ID does not exist" May 21 02:16:03.021874 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:03.021851 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:16:03.050479 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:03.050455 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58789ff8-drpxk"] May 21 02:16:04.952864 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:04.952837 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" path="/var/lib/kubelet/pods/4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa/volumes" May 21 02:16:10.501155 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501121 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d6675b4b9-n7j6w"] May 21 02:16:10.501508 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501417 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" containerName="manager" May 21 02:16:10.501508 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501428 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" containerName="manager" May 21 02:16:10.501508 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501438 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1354595-db4f-43b9-aa43-3ffad436cb3e" containerName="manager" May 21 02:16:10.501508 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501444 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1354595-db4f-43b9-aa43-3ffad436cb3e" containerName="manager" May 21 02:16:10.501634 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501514 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ac03f8c-ba5a-48a2-ab8e-94fe1478cefa" containerName="manager" May 21 02:16:10.501634 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.501525 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1354595-db4f-43b9-aa43-3ffad436cb3e" containerName="manager" May 21 02:16:10.506432 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.506411 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.508957 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.508932 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 02:16:10.508957 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.508952 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mrknn\"" May 21 02:16:10.510085 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.510050 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d6675b4b9-n7j6w"] May 21 02:16:10.588619 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.588590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdcf\" (UniqueName: \"kubernetes.io/projected/64f8117d-855c-488d-a936-a52aea742476-kube-api-access-dqdcf\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.588744 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.588625 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64f8117d-855c-488d-a936-a52aea742476-maas-api-tls\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.689713 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.689676 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdcf\" (UniqueName: \"kubernetes.io/projected/64f8117d-855c-488d-a936-a52aea742476-kube-api-access-dqdcf\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.689828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.689721 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64f8117d-855c-488d-a936-a52aea742476-maas-api-tls\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.692287 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.692257 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64f8117d-855c-488d-a936-a52aea742476-maas-api-tls\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.697323 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.697293 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdcf\" (UniqueName: \"kubernetes.io/projected/64f8117d-855c-488d-a936-a52aea742476-kube-api-access-dqdcf\") pod \"maas-api-5d6675b4b9-n7j6w\" (UID: \"64f8117d-855c-488d-a936-a52aea742476\") " pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.756571 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.756508 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2sz5x"] May 21 02:16:10.758769 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.758755 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:10.761357 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.761335 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wd9j9\"" May 21 02:16:10.761455 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.761385 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 02:16:10.766785 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.766762 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2sz5x"] May 21 02:16:10.817281 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.817260 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:10.891712 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.891680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmrw\" (UniqueName: \"kubernetes.io/projected/b82bedad-2e83-4b65-b0f3-a7365f108d6f-kube-api-access-2hmrw\") pod \"payload-processing-58b6c8fdc7-2sz5x\" (UID: \"b82bedad-2e83-4b65-b0f3-a7365f108d6f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:10.945108 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.945064 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d6675b4b9-n7j6w"] May 21 02:16:10.947611 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:16:10.947587 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f8117d_855c_488d_a936_a52aea742476.slice/crio-c39167e0f50b7a8d35a2f516f45a4caacfd4d3db31d5860a90f3dc09270cff33 WatchSource:0}: Error finding container c39167e0f50b7a8d35a2f516f45a4caacfd4d3db31d5860a90f3dc09270cff33: Status 404 returned error can't find the container with id c39167e0f50b7a8d35a2f516f45a4caacfd4d3db31d5860a90f3dc09270cff33 May 21 02:16:10.992725 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:10.992699 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmrw\" (UniqueName: \"kubernetes.io/projected/b82bedad-2e83-4b65-b0f3-a7365f108d6f-kube-api-access-2hmrw\") pod \"payload-processing-58b6c8fdc7-2sz5x\" (UID: \"b82bedad-2e83-4b65-b0f3-a7365f108d6f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:11.001831 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:11.001809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmrw\" (UniqueName: \"kubernetes.io/projected/b82bedad-2e83-4b65-b0f3-a7365f108d6f-kube-api-access-2hmrw\") pod \"payload-processing-58b6c8fdc7-2sz5x\" (UID: \"b82bedad-2e83-4b65-b0f3-a7365f108d6f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:11.012163 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:11.012105 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" event={"ID":"64f8117d-855c-488d-a936-a52aea742476","Type":"ContainerStarted","Data":"c39167e0f50b7a8d35a2f516f45a4caacfd4d3db31d5860a90f3dc09270cff33"} May 21 02:16:11.070495 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:11.070464 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:11.199742 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:11.199677 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2sz5x"] May 21 02:16:11.201874 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:16:11.201844 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82bedad_2e83_4b65_b0f3_a7365f108d6f.slice/crio-fd76d68ae898bd1620196fba012fafb8115f5356e5f16adcc88b577b4b1676d8 WatchSource:0}: Error finding container fd76d68ae898bd1620196fba012fafb8115f5356e5f16adcc88b577b4b1676d8: Status 404 returned error can't find the container with id fd76d68ae898bd1620196fba012fafb8115f5356e5f16adcc88b577b4b1676d8 May 21 02:16:12.016564 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:12.016525 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" event={"ID":"b82bedad-2e83-4b65-b0f3-a7365f108d6f","Type":"ContainerStarted","Data":"fd76d68ae898bd1620196fba012fafb8115f5356e5f16adcc88b577b4b1676d8"} May 21 02:16:13.021403 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.021365 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" event={"ID":"b82bedad-2e83-4b65-b0f3-a7365f108d6f","Type":"ContainerStarted","Data":"209e8cddeef9f46546adaa9044db5264343a365b361db035561cb9efb6526f32"} May 21 02:16:13.021828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.021430 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:13.022709 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.022687 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" event={"ID":"64f8117d-855c-488d-a936-a52aea742476","Type":"ContainerStarted","Data":"7ef27125b4ed98edab7e6a9d7091bfc3ddd61e213868fd273f3dfeec181305ba"} May 21 02:16:13.022838 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.022822 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:13.035398 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.035357 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" podStartSLOduration=1.375718484 podStartE2EDuration="3.03534578s" podCreationTimestamp="2026-05-21 02:16:10 +0000 UTC" firstStartedPulling="2026-05-21 02:16:11.203851706 +0000 UTC m=+666.824793657" lastFinishedPulling="2026-05-21 02:16:12.863479003 +0000 UTC m=+668.484420953" observedRunningTime="2026-05-21 02:16:13.033942522 +0000 UTC m=+668.654884491" watchObservedRunningTime="2026-05-21 02:16:13.03534578 +0000 UTC m=+668.656287748" May 21 02:16:13.048276 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:13.048235 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" podStartSLOduration=1.135979955 podStartE2EDuration="3.048225529s" podCreationTimestamp="2026-05-21 02:16:10 +0000 UTC" firstStartedPulling="2026-05-21 02:16:10.949005685 +0000 UTC m=+666.569947645" lastFinishedPulling="2026-05-21 02:16:12.861251269 +0000 UTC m=+668.482193219" observedRunningTime="2026-05-21 02:16:13.046433618 +0000 UTC m=+668.667375588" watchObservedRunningTime="2026-05-21 02:16:13.048225529 +0000 UTC m=+668.669167498" May 21 02:16:19.031802 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:19.031769 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d6675b4b9-n7j6w" May 21 02:16:24.027959 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:24.027924 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2sz5x" May 21 02:16:46.034341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.034309 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd"] May 21 02:16:46.039902 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.039882 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.042696 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.042682 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 02:16:46.042776 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.042700 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 02:16:46.043496 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.043480 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 02:16:46.043549 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.043491 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8cmcx\"" May 21 02:16:46.046627 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.046605 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd"] May 21 02:16:46.146347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146316 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.146347 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.146505 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146371 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4ng\" (UniqueName: \"kubernetes.io/projected/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kube-api-access-fz4ng\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.146505 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.146505 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.146597 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.146516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.246936 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.246903 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.246936 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.246941 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247209 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247183 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247289 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247273 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247334 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247319 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247334 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247432 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247354 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4ng\" (UniqueName: \"kubernetes.io/projected/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kube-api-access-fz4ng\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247483 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247471 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.247564 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.247541 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.249391 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.249362 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.249602 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.249577 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.255649 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.255630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4ng\" (UniqueName: \"kubernetes.io/projected/aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6-kube-api-access-fz4ng\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-mr9hd\" (UID: \"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.350265 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.350208 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:16:46.481196 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:46.481049 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd"] May 21 02:16:46.484029 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:16:46.483992 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaefc4ac_3ffb_4f36_ab8a_6cd0036ae8c6.slice/crio-04dfb2291a836fbad833f4e158470fb4fe4c7b3221c9ceb93158cbaaddd10759 WatchSource:0}: Error finding container 04dfb2291a836fbad833f4e158470fb4fe4c7b3221c9ceb93158cbaaddd10759: Status 404 returned error can't find the container with id 04dfb2291a836fbad833f4e158470fb4fe4c7b3221c9ceb93158cbaaddd10759 May 21 02:16:47.131009 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:47.130956 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" event={"ID":"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6","Type":"ContainerStarted","Data":"04dfb2291a836fbad833f4e158470fb4fe4c7b3221c9ceb93158cbaaddd10759"} May 21 02:16:54.157634 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:54.157556 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" event={"ID":"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6","Type":"ContainerStarted","Data":"515c4bf957b71269859bf336d1529fc38571d3a0849cbae0ae304112198f2975"} May 21 02:16:59.173883 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:59.173848 2552 generic.go:358] "Generic (PLEG): container finished" podID="aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6" containerID="515c4bf957b71269859bf336d1529fc38571d3a0849cbae0ae304112198f2975" exitCode=0 May 21 02:16:59.174244 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:59.173905 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" event={"ID":"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6","Type":"ContainerDied","Data":"515c4bf957b71269859bf336d1529fc38571d3a0849cbae0ae304112198f2975"} May 21 02:16:59.174419 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:16:59.174403 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:17:01.182584 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:01.182550 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" event={"ID":"aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6","Type":"ContainerStarted","Data":"34bb3dafc734cba06b174dbfa8f8c343aeaffcb6b738f3376a53078c0d2bafcc"} May 21 02:17:01.182987 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:01.182770 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:17:01.201258 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:01.201206 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" podStartSLOduration=1.3394138309999999 podStartE2EDuration="15.20119258s" podCreationTimestamp="2026-05-21 02:16:46 +0000 UTC" firstStartedPulling="2026-05-21 02:16:46.48886414 +0000 UTC m=+702.109806093" lastFinishedPulling="2026-05-21 02:17:00.350642892 +0000 UTC m=+715.971584842" observedRunningTime="2026-05-21 02:17:01.199451306 +0000 UTC m=+716.820393275" watchObservedRunningTime="2026-05-21 02:17:01.20119258 +0000 UTC m=+716.822134622" May 21 02:17:12.201039 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:12.201006 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-mr9hd" May 21 02:17:13.021222 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.021193 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt"] May 21 02:17:13.024481 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.024461 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.026881 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.026867 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 02:17:13.031506 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.031486 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt"] May 21 02:17:13.055104 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.055204 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qvrd\" (UniqueName: \"kubernetes.io/projected/e9f6eade-231d-411c-bb35-7130506161f2-kube-api-access-8qvrd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.055204 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.055331 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9f6eade-231d-411c-bb35-7130506161f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.055331 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055327 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.055532 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.055508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.156848 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.156816 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.156866 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.156895 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qvrd\" (UniqueName: \"kubernetes.io/projected/e9f6eade-231d-411c-bb35-7130506161f2-kube-api-access-8qvrd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.156921 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.156951 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9f6eade-231d-411c-bb35-7130506161f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157012 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.157003 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157361 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.157243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157361 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.157284 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.157361 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.157331 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.159122 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.159101 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9f6eade-231d-411c-bb35-7130506161f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.159391 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.159368 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9f6eade-231d-411c-bb35-7130506161f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.164112 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.164092 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qvrd\" (UniqueName: \"kubernetes.io/projected/e9f6eade-231d-411c-bb35-7130506161f2-kube-api-access-8qvrd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt\" (UID: \"e9f6eade-231d-411c-bb35-7130506161f2\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.334387 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.334308 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:13.468058 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:13.468032 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt"] May 21 02:17:13.470300 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:17:13.470271 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f6eade_231d_411c_bb35_7130506161f2.slice/crio-97b68ea123fcb07c089d0c2cbca9dfdf533ea75d2dbb97f11942153acaf79ac0 WatchSource:0}: Error finding container 97b68ea123fcb07c089d0c2cbca9dfdf533ea75d2dbb97f11942153acaf79ac0: Status 404 returned error can't find the container with id 97b68ea123fcb07c089d0c2cbca9dfdf533ea75d2dbb97f11942153acaf79ac0 May 21 02:17:14.231933 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:14.231886 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" event={"ID":"e9f6eade-231d-411c-bb35-7130506161f2","Type":"ContainerStarted","Data":"6dcbc32db07ad15b750a3ec9116b5379dd82c7f923fa1778485c623519703eda"} May 21 02:17:14.231933 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:14.231931 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" event={"ID":"e9f6eade-231d-411c-bb35-7130506161f2","Type":"ContainerStarted","Data":"97b68ea123fcb07c089d0c2cbca9dfdf533ea75d2dbb97f11942153acaf79ac0"} May 21 02:17:16.743563 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.743529 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt"] May 21 02:17:16.746341 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.746321 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.749073 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.749050 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 02:17:16.754165 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.753998 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt"] May 21 02:17:16.791691 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.791820 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.791820 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791742 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.791820 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791809 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.791951 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ad7c48-8426-4aaa-a165-39293b2b9b7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.791951 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.791895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qsct\" (UniqueName: \"kubernetes.io/projected/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kube-api-access-4qsct\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892783 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892755 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892798 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ad7c48-8426-4aaa-a165-39293b2b9b7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892839 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qsct\" (UniqueName: \"kubernetes.io/projected/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kube-api-access-4qsct\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892869 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892901 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.892939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.892930 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.893217 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.893203 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.893492 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.893467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.893576 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.893494 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.895144 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.895126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91ad7c48-8426-4aaa-a165-39293b2b9b7f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.895828 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.895808 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ad7c48-8426-4aaa-a165-39293b2b9b7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:16.902663 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:16.902641 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qsct\" (UniqueName: \"kubernetes.io/projected/91ad7c48-8426-4aaa-a165-39293b2b9b7f-kube-api-access-4qsct\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt\" (UID: \"91ad7c48-8426-4aaa-a165-39293b2b9b7f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:17.058444 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.058407 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:17.204176 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.204149 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt"] May 21 02:17:17.207888 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:17:17.207852 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ad7c48_8426_4aaa_a165_39293b2b9b7f.slice/crio-e7d29ca40a7e3eed5eaa3f58d334262787fb37ffca3f07a6ef0f3f638c8a26fb WatchSource:0}: Error finding container e7d29ca40a7e3eed5eaa3f58d334262787fb37ffca3f07a6ef0f3f638c8a26fb: Status 404 returned error can't find the container with id e7d29ca40a7e3eed5eaa3f58d334262787fb37ffca3f07a6ef0f3f638c8a26fb May 21 02:17:17.246261 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.246231 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" event={"ID":"91ad7c48-8426-4aaa-a165-39293b2b9b7f","Type":"ContainerStarted","Data":"e7d29ca40a7e3eed5eaa3f58d334262787fb37ffca3f07a6ef0f3f638c8a26fb"} May 21 02:17:17.631870 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.631142 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6"] May 21 02:17:17.665615 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.665586 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6"] May 21 02:17:17.665770 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.665694 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.670733 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.670708 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 02:17:17.700930 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.700896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.701079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.700935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.701079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.700954 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqbr\" (UniqueName: \"kubernetes.io/projected/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kube-api-access-mvqbr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.701079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.700993 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.701265 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.701072 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.701265 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.701140 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802233 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802690 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802246 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802690 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802345 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802690 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802388 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802690 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802415 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqbr\" (UniqueName: \"kubernetes.io/projected/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kube-api-access-mvqbr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802690 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802446 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.802990 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.802874 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.803059 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.803010 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.803221 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.803197 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.805443 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.805427 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.805832 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.805809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.810338 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.810314 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqbr\" (UniqueName: \"kubernetes.io/projected/e54ae9c3-d2f0-4937-a126-cabaab4c2de4-kube-api-access-mvqbr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6\" (UID: \"e54ae9c3-d2f0-4937-a126-cabaab4c2de4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:17.981658 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:17.981586 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:18.144986 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:18.144574 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6"] May 21 02:17:18.150063 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:17:18.150023 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54ae9c3_d2f0_4937_a126_cabaab4c2de4.slice/crio-d223c0a5229eaa8054b0206f3dc6a024220c4671d88f86515e8f1650d7013bcc WatchSource:0}: Error finding container d223c0a5229eaa8054b0206f3dc6a024220c4671d88f86515e8f1650d7013bcc: Status 404 returned error can't find the container with id d223c0a5229eaa8054b0206f3dc6a024220c4671d88f86515e8f1650d7013bcc May 21 02:17:18.252759 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:18.252723 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" event={"ID":"91ad7c48-8426-4aaa-a165-39293b2b9b7f","Type":"ContainerStarted","Data":"a99fe7e8eadd9563182bc8026f00632bca14ef48cdafe52a924feea2fb06398b"} May 21 02:17:18.253888 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:18.253861 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" event={"ID":"e54ae9c3-d2f0-4937-a126-cabaab4c2de4","Type":"ContainerStarted","Data":"d223c0a5229eaa8054b0206f3dc6a024220c4671d88f86515e8f1650d7013bcc"} May 21 02:17:19.259696 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:19.259661 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" event={"ID":"e54ae9c3-d2f0-4937-a126-cabaab4c2de4","Type":"ContainerStarted","Data":"f706728dba907e4bce2a2a0ff7fc8f775b6ca31dfa18ec75c712e99ca074960f"} May 21 02:17:22.275340 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:22.275300 2552 generic.go:358] "Generic (PLEG): container finished" podID="e9f6eade-231d-411c-bb35-7130506161f2" containerID="6dcbc32db07ad15b750a3ec9116b5379dd82c7f923fa1778485c623519703eda" exitCode=0 May 21 02:17:22.275805 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:22.275382 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" event={"ID":"e9f6eade-231d-411c-bb35-7130506161f2","Type":"ContainerDied","Data":"6dcbc32db07ad15b750a3ec9116b5379dd82c7f923fa1778485c623519703eda"} May 21 02:17:23.279855 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:23.279825 2552 generic.go:358] "Generic (PLEG): container finished" podID="91ad7c48-8426-4aaa-a165-39293b2b9b7f" containerID="a99fe7e8eadd9563182bc8026f00632bca14ef48cdafe52a924feea2fb06398b" exitCode=0 May 21 02:17:23.280280 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:23.279906 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" event={"ID":"91ad7c48-8426-4aaa-a165-39293b2b9b7f","Type":"ContainerDied","Data":"a99fe7e8eadd9563182bc8026f00632bca14ef48cdafe52a924feea2fb06398b"} May 21 02:17:23.281572 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:23.281547 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" event={"ID":"e9f6eade-231d-411c-bb35-7130506161f2","Type":"ContainerStarted","Data":"bfa2966c9e2e5c49be766d7b76d3d93c56718925747f0ddb155357ae581e4cbd"} May 21 02:17:23.281760 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:23.281742 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:23.312167 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:23.312091 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" podStartSLOduration=10.103747638 podStartE2EDuration="10.312076283s" podCreationTimestamp="2026-05-21 02:17:13 +0000 UTC" firstStartedPulling="2026-05-21 02:17:22.276012975 +0000 UTC m=+737.896954925" lastFinishedPulling="2026-05-21 02:17:22.484341623 +0000 UTC m=+738.105283570" observedRunningTime="2026-05-21 02:17:23.311362488 +0000 UTC m=+738.932304470" watchObservedRunningTime="2026-05-21 02:17:23.312076283 +0000 UTC m=+738.933018252" May 21 02:17:24.286886 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:24.286689 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" event={"ID":"91ad7c48-8426-4aaa-a165-39293b2b9b7f","Type":"ContainerStarted","Data":"52d636734b0a78797e0b0a1a999e151fa60099dac3ebc8a860c3dab92761e183"} May 21 02:17:24.287497 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:24.287475 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:24.288754 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:24.288676 2552 generic.go:358] "Generic (PLEG): container finished" podID="e54ae9c3-d2f0-4937-a126-cabaab4c2de4" containerID="f706728dba907e4bce2a2a0ff7fc8f775b6ca31dfa18ec75c712e99ca074960f" exitCode=0 May 21 02:17:24.290084 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:24.289119 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" event={"ID":"e54ae9c3-d2f0-4937-a126-cabaab4c2de4","Type":"ContainerDied","Data":"f706728dba907e4bce2a2a0ff7fc8f775b6ca31dfa18ec75c712e99ca074960f"} May 21 02:17:24.307551 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:24.307509 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" podStartSLOduration=8.092070839 podStartE2EDuration="8.307497291s" podCreationTimestamp="2026-05-21 02:17:16 +0000 UTC" firstStartedPulling="2026-05-21 02:17:23.280658488 +0000 UTC m=+738.901600435" lastFinishedPulling="2026-05-21 02:17:23.496084928 +0000 UTC m=+739.117026887" observedRunningTime="2026-05-21 02:17:24.305809016 +0000 UTC m=+739.926750978" watchObservedRunningTime="2026-05-21 02:17:24.307497291 +0000 UTC m=+739.928439293" May 21 02:17:25.295237 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:25.295194 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" event={"ID":"e54ae9c3-d2f0-4937-a126-cabaab4c2de4","Type":"ContainerStarted","Data":"d39b2e6b2f660c2196a9acea5b002f4a3a37486c003d4e87eb5b49e77bb059c3"} May 21 02:17:25.295817 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:25.295795 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:17:25.313535 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:25.313490 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" podStartSLOduration=8.118242414 podStartE2EDuration="8.313476473s" podCreationTimestamp="2026-05-21 02:17:17 +0000 UTC" firstStartedPulling="2026-05-21 02:17:24.289773358 +0000 UTC m=+739.910715310" lastFinishedPulling="2026-05-21 02:17:24.485007409 +0000 UTC m=+740.105949369" observedRunningTime="2026-05-21 02:17:25.311808897 +0000 UTC m=+740.932750949" watchObservedRunningTime="2026-05-21 02:17:25.313476473 +0000 UTC m=+740.934418442" May 21 02:17:34.304410 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:34.304378 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt" May 21 02:17:35.308934 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:35.308908 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt" May 21 02:17:36.310656 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:17:36.310628 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6" May 21 02:19:07.394346 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.394314 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:19:07.395067 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.394567 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-786cc58767-jhfn6" podUID="592c57fc-872c-4ab8-8dca-693b5c1e3535" containerName="manager" containerID="cri-o://0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d" gracePeriod=30 May 21 02:19:07.642665 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.642643 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:19:07.653711 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.653638 2552 generic.go:358] "Generic (PLEG): container finished" podID="592c57fc-872c-4ab8-8dca-693b5c1e3535" containerID="0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d" exitCode=0 May 21 02:19:07.653803 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.653706 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-jhfn6" event={"ID":"592c57fc-872c-4ab8-8dca-693b5c1e3535","Type":"ContainerDied","Data":"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d"} May 21 02:19:07.653803 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.653742 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-jhfn6" event={"ID":"592c57fc-872c-4ab8-8dca-693b5c1e3535","Type":"ContainerDied","Data":"4283db078af74a0774bf4147b2411c9827382b1d7445ed8554b59728bc4aad31"} May 21 02:19:07.653803 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.653761 2552 scope.go:117] "RemoveContainer" containerID="0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d" May 21 02:19:07.653803 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.653710 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-jhfn6" May 21 02:19:07.662391 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.662374 2552 scope.go:117] "RemoveContainer" containerID="0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d" May 21 02:19:07.662670 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:19:07.662649 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d\": container with ID starting with 0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d not found: ID does not exist" containerID="0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d" May 21 02:19:07.662837 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.662678 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d"} err="failed to get container status \"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d\": rpc error: code = NotFound desc = could not find container \"0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d\": container with ID starting with 0ec29781324df2deb9c45e5251eb2efa53eb64bee6dc37d011c197bbf6bf998d not found: ID does not exist" May 21 02:19:07.747868 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.747843 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj\") pod \"592c57fc-872c-4ab8-8dca-693b5c1e3535\" (UID: \"592c57fc-872c-4ab8-8dca-693b5c1e3535\") " May 21 02:19:07.749792 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.749769 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj" (OuterVolumeSpecName: "kube-api-access-2cdzj") pod "592c57fc-872c-4ab8-8dca-693b5c1e3535" (UID: "592c57fc-872c-4ab8-8dca-693b5c1e3535"). InnerVolumeSpecName "kube-api-access-2cdzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:19:07.848459 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.848436 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdzj\" (UniqueName: \"kubernetes.io/projected/592c57fc-872c-4ab8-8dca-693b5c1e3535-kube-api-access-2cdzj\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:19:07.974585 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.974558 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:19:07.977790 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:07.977767 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-786cc58767-jhfn6"] May 21 02:19:08.679225 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.679197 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-786cc58767-mwzsw"] May 21 02:19:08.679561 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.679551 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592c57fc-872c-4ab8-8dca-693b5c1e3535" containerName="manager" May 21 02:19:08.679601 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.679561 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="592c57fc-872c-4ab8-8dca-693b5c1e3535" containerName="manager" May 21 02:19:08.679635 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.679615 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="592c57fc-872c-4ab8-8dca-693b5c1e3535" containerName="manager" May 21 02:19:08.681649 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.681634 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:08.684079 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.684058 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jfqq7\"" May 21 02:19:08.689747 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.689705 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786cc58767-mwzsw"] May 21 02:19:08.756313 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.756286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf7l8\" (UniqueName: \"kubernetes.io/projected/a01f0446-b60b-4635-be0e-79d1ea22323b-kube-api-access-nf7l8\") pod \"maas-controller-786cc58767-mwzsw\" (UID: \"a01f0446-b60b-4635-be0e-79d1ea22323b\") " pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:08.856723 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.856703 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nf7l8\" (UniqueName: \"kubernetes.io/projected/a01f0446-b60b-4635-be0e-79d1ea22323b-kube-api-access-nf7l8\") pod \"maas-controller-786cc58767-mwzsw\" (UID: \"a01f0446-b60b-4635-be0e-79d1ea22323b\") " pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:08.866115 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.866091 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf7l8\" (UniqueName: \"kubernetes.io/projected/a01f0446-b60b-4635-be0e-79d1ea22323b-kube-api-access-nf7l8\") pod \"maas-controller-786cc58767-mwzsw\" (UID: \"a01f0446-b60b-4635-be0e-79d1ea22323b\") " pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:08.953945 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.953888 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592c57fc-872c-4ab8-8dca-693b5c1e3535" path="/var/lib/kubelet/pods/592c57fc-872c-4ab8-8dca-693b5c1e3535/volumes" May 21 02:19:08.992655 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:08.992625 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:09.117286 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:09.117249 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786cc58767-mwzsw"] May 21 02:19:09.120103 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:19:09.120078 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01f0446_b60b_4635_be0e_79d1ea22323b.slice/crio-816c92370793e83bb63c1c91a0f2eae4b4a9566b83972f14d2aaee6df026d815 WatchSource:0}: Error finding container 816c92370793e83bb63c1c91a0f2eae4b4a9566b83972f14d2aaee6df026d815: Status 404 returned error can't find the container with id 816c92370793e83bb63c1c91a0f2eae4b4a9566b83972f14d2aaee6df026d815 May 21 02:19:09.662854 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:09.662821 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-mwzsw" event={"ID":"a01f0446-b60b-4635-be0e-79d1ea22323b","Type":"ContainerStarted","Data":"baf928dcdbb426dab0cc32bc1875151d0567cbe288e899223fcc37afc4d89068"} May 21 02:19:09.662854 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:09.662855 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786cc58767-mwzsw" event={"ID":"a01f0446-b60b-4635-be0e-79d1ea22323b","Type":"ContainerStarted","Data":"816c92370793e83bb63c1c91a0f2eae4b4a9566b83972f14d2aaee6df026d815"} May 21 02:19:09.663070 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:09.662944 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:19:09.677821 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:09.677776 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-786cc58767-mwzsw" podStartSLOduration=1.301569516 podStartE2EDuration="1.677760249s" podCreationTimestamp="2026-05-21 02:19:08 +0000 UTC" firstStartedPulling="2026-05-21 02:19:09.121358433 +0000 UTC m=+844.742300380" lastFinishedPulling="2026-05-21 02:19:09.497549164 +0000 UTC m=+845.118491113" observedRunningTime="2026-05-21 02:19:09.677458682 +0000 UTC m=+845.298400652" watchObservedRunningTime="2026-05-21 02:19:09.677760249 +0000 UTC m=+845.298702218" May 21 02:19:20.671983 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:19:20.671936 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-786cc58767-mwzsw" May 21 02:20:04.943553 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:20:04.943484 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:20:04.945503 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:20:04.945480 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:25:04.969446 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:25:04.969415 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:25:04.970670 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:25:04.970648 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:29:22.731199 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:22.731107 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:29:22.733629 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:22.731415 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" podUID="eee1b386-d3d7-4139-b7f8-010ba94b207e" containerName="manager" containerID="cri-o://e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0" gracePeriod=10 May 21 02:29:22.980674 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:22.980649 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:29:23.075795 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.075768 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume\") pod \"eee1b386-d3d7-4139-b7f8-010ba94b207e\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " May 21 02:29:23.075939 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.075875 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fqwq\" (UniqueName: \"kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq\") pod \"eee1b386-d3d7-4139-b7f8-010ba94b207e\" (UID: \"eee1b386-d3d7-4139-b7f8-010ba94b207e\") " May 21 02:29:23.076127 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.076106 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eee1b386-d3d7-4139-b7f8-010ba94b207e" (UID: "eee1b386-d3d7-4139-b7f8-010ba94b207e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:29:23.077784 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.077759 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq" (OuterVolumeSpecName: "kube-api-access-2fqwq") pod "eee1b386-d3d7-4139-b7f8-010ba94b207e" (UID: "eee1b386-d3d7-4139-b7f8-010ba94b207e"). InnerVolumeSpecName "kube-api-access-2fqwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:29:23.177197 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.177159 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fqwq\" (UniqueName: \"kubernetes.io/projected/eee1b386-d3d7-4139-b7f8-010ba94b207e-kube-api-access-2fqwq\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:29:23.177197 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.177194 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eee1b386-d3d7-4139-b7f8-010ba94b207e-extensions-socket-volume\") on node \"ip-10-0-130-115.ec2.internal\" DevicePath \"\"" May 21 02:29:23.713839 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.713803 2552 generic.go:358] "Generic (PLEG): container finished" podID="eee1b386-d3d7-4139-b7f8-010ba94b207e" containerID="e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0" exitCode=0 May 21 02:29:23.714065 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.713886 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" May 21 02:29:23.714065 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.713890 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" event={"ID":"eee1b386-d3d7-4139-b7f8-010ba94b207e","Type":"ContainerDied","Data":"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0"} May 21 02:29:23.714065 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.713933 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf" event={"ID":"eee1b386-d3d7-4139-b7f8-010ba94b207e","Type":"ContainerDied","Data":"f89669adcd97bd5d2c8f4c11f3aeaeda17313dfbf924e787498eeff322fb4792"} May 21 02:29:23.714065 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.713950 2552 scope.go:117] "RemoveContainer" containerID="e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0" May 21 02:29:23.724136 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.724118 2552 scope.go:117] "RemoveContainer" containerID="e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0" May 21 02:29:23.724408 ip-10-0-130-115 kubenswrapper[2552]: E0521 02:29:23.724379 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0\": container with ID starting with e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0 not found: ID does not exist" containerID="e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0" May 21 02:29:23.724408 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.724413 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0"} err="failed to get container status \"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0\": rpc error: code = NotFound desc = could not find container \"e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0\": container with ID starting with e71b940bf9c7f45c027b867f3a07f7ee910af9da2d158bc23795e5bc69b2dab0 not found: ID does not exist" May 21 02:29:23.734926 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.734900 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:29:23.737470 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:23.737444 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qxhcf"] May 21 02:29:24.953635 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:29:24.953602 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee1b386-d3d7-4139-b7f8-010ba94b207e" path="/var/lib/kubelet/pods/eee1b386-d3d7-4139-b7f8-010ba94b207e/volumes" May 21 02:30:04.990278 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:04.990252 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:30:04.992256 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:04.992233 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:30:28.817414 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.817370 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l"] May 21 02:30:28.817912 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.817889 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee1b386-d3d7-4139-b7f8-010ba94b207e" containerName="manager" May 21 02:30:28.818015 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.817916 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee1b386-d3d7-4139-b7f8-010ba94b207e" containerName="manager" May 21 02:30:28.818074 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.818043 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="eee1b386-d3d7-4139-b7f8-010ba94b207e" containerName="manager" May 21 02:30:28.820974 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.820936 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.823731 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.823711 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 02:30:28.824085 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.824068 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 02:30:28.824216 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.824197 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pb52c\"" May 21 02:30:28.834364 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.834340 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l"] May 21 02:30:28.885205 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.885176 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8dbw\" (UniqueName: \"kubernetes.io/projected/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-kube-api-access-x8dbw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.885310 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.885246 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.985711 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.985683 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.985814 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.985757 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8dbw\" (UniqueName: \"kubernetes.io/projected/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-kube-api-access-x8dbw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.986270 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.986251 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:28.996139 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:28.996115 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8dbw\" (UniqueName: \"kubernetes.io/projected/05ffad2d-3f6e-4aa0-b791-e34c418de2e0-kube-api-access-x8dbw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dk52l\" (UID: \"05ffad2d-3f6e-4aa0-b791-e34c418de2e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:29.131868 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.131816 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:29.277338 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.276264 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l"] May 21 02:30:29.280426 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:30:29.280390 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ffad2d_3f6e_4aa0_b791_e34c418de2e0.slice/crio-2e275c508acbad16f648ad0bb19369dd18d75244e9af2fd51e82ef77d97628bd WatchSource:0}: Error finding container 2e275c508acbad16f648ad0bb19369dd18d75244e9af2fd51e82ef77d97628bd: Status 404 returned error can't find the container with id 2e275c508acbad16f648ad0bb19369dd18d75244e9af2fd51e82ef77d97628bd May 21 02:30:29.282793 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.282772 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:30:29.955673 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.955635 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" event={"ID":"05ffad2d-3f6e-4aa0-b791-e34c418de2e0","Type":"ContainerStarted","Data":"81125a2bf88322282e91b023836ff93fc726edbfc4da4c23eb139da25811d01c"} May 21 02:30:29.955673 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.955679 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" event={"ID":"05ffad2d-3f6e-4aa0-b791-e34c418de2e0","Type":"ContainerStarted","Data":"2e275c508acbad16f648ad0bb19369dd18d75244e9af2fd51e82ef77d97628bd"} May 21 02:30:29.956120 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.955727 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:30:29.977490 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:29.977436 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" podStartSLOduration=1.977418828 podStartE2EDuration="1.977418828s" podCreationTimestamp="2026-05-21 02:30:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:30:29.975135164 +0000 UTC m=+1525.596077124" watchObservedRunningTime="2026-05-21 02:30:29.977418828 +0000 UTC m=+1525.598360798" May 21 02:30:40.961564 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:30:40.961533 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dk52l" May 21 02:35:05.013015 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:35:05.012984 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:35:05.015091 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:35:05.015068 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:40:05.034715 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:05.034686 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:40:05.040368 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:05.040347 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:40:11.112360 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:11.112327 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-pw74l_c3201cf8-a92f-4ea4-9782-a67dee1a8a44/manager/0.log" May 21 02:40:11.222167 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:11.222127 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d6675b4b9-n7j6w_64f8117d-855c-488d-a936-a52aea742476/maas-api/0.log" May 21 02:40:11.452866 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:11.452770 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-786cc58767-mwzsw_a01f0446-b60b-4635-be0e-79d1ea22323b/manager/0.log" May 21 02:40:11.566351 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:11.566321 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2ttpz_2e3c5227-cb2d-4b48-9736-d5630a4de0e7/manager/1.log" May 21 02:40:11.678460 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:11.678434 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784fb9f5c5-2mkvp_f3c7fb2b-ce85-411e-b098-4f8af7b914c9/manager/0.log" May 21 02:40:12.004312 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:12.004251 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4bwr6_fc707458-3fdf-4fd9-8e08-70d644cebc5d/postgres/0.log" May 21 02:40:13.768283 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:13.768252 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-dk52l_05ffad2d-3f6e-4aa0-b791-e34c418de2e0/manager/0.log" May 21 02:40:14.431225 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:14.431183 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dwftr_a056206b-8e8d-45c4-ac8f-cbd2590aedc7/discovery/0.log" May 21 02:40:14.638736 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:14.638708 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfbc4f554-vcm92_c57d306a-a067-4c7a-b648-8e0c8d915ecc/kube-auth-proxy/0.log" May 21 02:40:14.864145 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:14.864120 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2sz5x_b82bedad-2e83-4b65-b0f3-a7365f108d6f/payload-processing/0.log" May 21 02:40:15.409851 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.409828 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt_91ad7c48-8426-4aaa-a165-39293b2b9b7f/storage-initializer/0.log" May 21 02:40:15.415787 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.415766 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-vrglt_91ad7c48-8426-4aaa-a165-39293b2b9b7f/main/0.log" May 21 02:40:15.526199 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.526176 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-mr9hd_aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6/storage-initializer/0.log" May 21 02:40:15.532935 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.532913 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-mr9hd_aaefc4ac-3ffb-4f36-ab8a-6cd0036ae8c6/main/0.log" May 21 02:40:15.635573 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.635546 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6_e54ae9c3-d2f0-4937-a126-cabaab4c2de4/storage-initializer/0.log" May 21 02:40:15.641166 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.641151 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvpzz6_e54ae9c3-d2f0-4937-a126-cabaab4c2de4/main/0.log" May 21 02:40:15.858929 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.858907 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt_e9f6eade-231d-411c-bb35-7130506161f2/storage-initializer/0.log" May 21 02:40:15.865373 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:15.865349 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dbpmt_e9f6eade-231d-411c-bb35-7130506161f2/main/0.log" May 21 02:40:22.362738 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:22.362706 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ft8tt_d251bf9b-69de-4118-9cf4-0767ecba2b84/global-pull-secret-syncer/0.log" May 21 02:40:22.435292 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:22.435267 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-48rm2_3136e3e9-5db7-415d-b52c-7dffb1022878/konnectivity-agent/0.log" May 21 02:40:22.515797 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:22.515772 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-115.ec2.internal_993db9f6b73c4a043185a7c9cde0d880/haproxy/0.log" May 21 02:40:27.063768 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:27.063741 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-dk52l_05ffad2d-3f6e-4aa0-b791-e34c418de2e0/manager/0.log" May 21 02:40:28.919873 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:28.919776 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/node-exporter/0.log" May 21 02:40:28.937275 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:28.937254 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/kube-rbac-proxy/0.log" May 21 02:40:28.956806 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:28.956784 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcq8q_e12927a8-3e93-49f7-822c-36bf79cef710/init-textfile/0.log" May 21 02:40:30.507011 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.506960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-x5xwf_c829d797-891b-4962-9c7e-5ba537adb281/networking-console-plugin/0.log" May 21 02:40:30.935718 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.935691 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg"] May 21 02:40:30.938995 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.938958 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:30.941345 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.941325 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khz4\"/\"kube-root-ca.crt\"" May 21 02:40:30.941479 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.941396 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khz4\"/\"openshift-service-ca.crt\"" May 21 02:40:30.942492 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.942470 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6khz4\"/\"default-dockercfg-dhq48\"" May 21 02:40:30.948028 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:30.948006 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg"] May 21 02:40:31.090516 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.090488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-proc\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.090671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.090538 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpq7r\" (UniqueName: \"kubernetes.io/projected/de37485e-d475-40b5-a4f2-a81c461ee40d-kube-api-access-mpq7r\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.090671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.090589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-lib-modules\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.090763 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.090678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-sys\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.090763 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.090703 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-podres\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191272 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-sys\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191272 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191229 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-podres\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191285 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-proc\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191296 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-sys\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191322 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpq7r\" (UniqueName: \"kubernetes.io/projected/de37485e-d475-40b5-a4f2-a81c461ee40d-kube-api-access-mpq7r\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191346 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-proc\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191348 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-lib-modules\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191480 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191415 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-podres\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.191698 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.191485 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de37485e-d475-40b5-a4f2-a81c461ee40d-lib-modules\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.198434 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.198413 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpq7r\" (UniqueName: \"kubernetes.io/projected/de37485e-d475-40b5-a4f2-a81c461ee40d-kube-api-access-mpq7r\") pod \"perf-node-gather-daemonset-vwrzg\" (UID: \"de37485e-d475-40b5-a4f2-a81c461ee40d\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.250479 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.250444 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:31.375671 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.375645 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg"] May 21 02:40:31.377441 ip-10-0-130-115 kubenswrapper[2552]: W0521 02:40:31.377413 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde37485e_d475_40b5_a4f2_a81c461ee40d.slice/crio-5b39e4ad54f6ecd7df0245dcd928256ffb9e7b4e990c0a6e0ffbce8698e7d69c WatchSource:0}: Error finding container 5b39e4ad54f6ecd7df0245dcd928256ffb9e7b4e990c0a6e0ffbce8698e7d69c: Status 404 returned error can't find the container with id 5b39e4ad54f6ecd7df0245dcd928256ffb9e7b4e990c0a6e0ffbce8698e7d69c May 21 02:40:31.379118 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:31.379101 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:40:32.014959 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.014922 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" event={"ID":"de37485e-d475-40b5-a4f2-a81c461ee40d","Type":"ContainerStarted","Data":"dd4678c30cf94aa0289c3ddfe30aa2fbec0ace515ef3669dfc1e08c39faeb1e1"} May 21 02:40:32.014959 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.014959 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" event={"ID":"de37485e-d475-40b5-a4f2-a81c461ee40d","Type":"ContainerStarted","Data":"5b39e4ad54f6ecd7df0245dcd928256ffb9e7b4e990c0a6e0ffbce8698e7d69c"} May 21 02:40:32.015378 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.015077 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:32.030675 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.030627 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" podStartSLOduration=2.030614865 podStartE2EDuration="2.030614865s" podCreationTimestamp="2026-05-21 02:40:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:40:32.029762267 +0000 UTC m=+2127.650704261" watchObservedRunningTime="2026-05-21 02:40:32.030614865 +0000 UTC m=+2127.651557101" May 21 02:40:32.823364 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.823334 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8h7nk_0f12ba82-e7fa-4d58-9e4c-d495e49c2a26/dns/0.log" May 21 02:40:32.840786 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.840762 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8h7nk_0f12ba82-e7fa-4d58-9e4c-d495e49c2a26/kube-rbac-proxy/0.log" May 21 02:40:32.954308 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:32.954282 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gg4lt_8b35b488-aed7-4e2b-b946-008b29b38c79/dns-node-resolver/0.log" May 21 02:40:33.439991 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:33.439946 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6dg7x_5be69ed9-72da-481e-b8b4-a83fbb16cb4a/node-ca/0.log" May 21 02:40:34.317195 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:34.317167 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dwftr_a056206b-8e8d-45c4-ac8f-cbd2590aedc7/discovery/0.log" May 21 02:40:34.356512 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:34.356485 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfbc4f554-vcm92_c57d306a-a067-4c7a-b648-8e0c8d915ecc/kube-auth-proxy/0.log" May 21 02:40:34.487523 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:34.487494 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2sz5x_b82bedad-2e83-4b65-b0f3-a7365f108d6f/payload-processing/0.log" May 21 02:40:34.999256 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:34.999227 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jkdrp_27ee78eb-2bd4-446f-8ee3-fd763af995e8/serve-healthcheck-canary/0.log" May 21 02:40:35.467523 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:35.467496 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hb_d8ea7904-4f3f-417a-a04e-9d57818cecd2/kube-rbac-proxy/0.log" May 21 02:40:35.485385 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:35.485366 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hb_d8ea7904-4f3f-417a-a04e-9d57818cecd2/exporter/0.log" May 21 02:40:35.503102 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:35.503075 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hb_d8ea7904-4f3f-417a-a04e-9d57818cecd2/extractor/0.log" May 21 02:40:37.381075 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.381045 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-pw74l_c3201cf8-a92f-4ea4-9782-a67dee1a8a44/manager/0.log" May 21 02:40:37.409539 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.409513 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d6675b4b9-n7j6w_64f8117d-855c-488d-a936-a52aea742476/maas-api/0.log" May 21 02:40:37.494630 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.494603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-786cc58767-mwzsw_a01f0446-b60b-4635-be0e-79d1ea22323b/manager/0.log" May 21 02:40:37.510554 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.510531 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2ttpz_2e3c5227-cb2d-4b48-9736-d5630a4de0e7/manager/0.log" May 21 02:40:37.521267 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.521244 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2ttpz_2e3c5227-cb2d-4b48-9736-d5630a4de0e7/manager/1.log" May 21 02:40:37.539561 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.539539 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784fb9f5c5-2mkvp_f3c7fb2b-ce85-411e-b098-4f8af7b914c9/manager/0.log" May 21 02:40:37.630160 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:37.630140 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4bwr6_fc707458-3fdf-4fd9-8e08-70d644cebc5d/postgres/0.log" May 21 02:40:38.027595 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:38.027570 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-vwrzg" May 21 02:40:38.748075 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:38.748050 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-xwq96_2726f6f5-3116-405e-8c63-6668ca8cec23/openshift-lws-operator/0.log" May 21 02:40:44.320162 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.320135 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7srjx_08441043-1984-4640-828c-c907920d4114/kube-multus/0.log" May 21 02:40:44.608787 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.608726 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/kube-multus-additional-cni-plugins/0.log" May 21 02:40:44.625781 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.625760 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/egress-router-binary-copy/0.log" May 21 02:40:44.642074 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.642054 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/cni-plugins/0.log" May 21 02:40:44.659014 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.658988 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/bond-cni-plugin/0.log" May 21 02:40:44.677336 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.677314 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/routeoverride-cni/0.log" May 21 02:40:44.695904 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.695881 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/whereabouts-cni-bincopy/0.log" May 21 02:40:44.712670 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.712642 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk5l7_db43fb98-0b07-448c-abd1-52033ba1f2aa/whereabouts-cni/0.log" May 21 02:40:44.827417 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.827387 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzdpr_cbe31c48-085f-4d57-9709-eabdf2ae3113/network-metrics-daemon/0.log" May 21 02:40:44.843570 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:44.843547 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzdpr_cbe31c48-085f-4d57-9709-eabdf2ae3113/kube-rbac-proxy/0.log" May 21 02:40:46.185108 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.185078 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-controller/0.log" May 21 02:40:46.200078 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.200050 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/0.log" May 21 02:40:46.210764 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.210740 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovn-acl-logging/1.log" May 21 02:40:46.227742 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.227718 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/kube-rbac-proxy-node/0.log" May 21 02:40:46.247442 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.247424 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/kube-rbac-proxy-ovn-metrics/0.log" May 21 02:40:46.266917 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.266896 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/northd/0.log" May 21 02:40:46.284780 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.284754 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/nbdb/0.log" May 21 02:40:46.302159 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.302138 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/sbdb/0.log" May 21 02:40:46.394559 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:46.394536 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhf6f_5c9ee481-9c3d-49ac-828d-450ba62b5d20/ovnkube-controller/0.log" May 21 02:40:47.425090 ip-10-0-130-115 kubenswrapper[2552]: I0521 02:40:47.425061 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c7g5p_fbc00dba-6714-42fd-813c-e207633c6cf8/network-check-target-container/0.log"