Jun 07 16:01:51.405078 ip-10-0-142-225 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:01:51.813316 ip-10-0-142-225 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:51.813316 ip-10-0-142-225 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:01:51.813316 ip-10-0-142-225 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:51.813316 ip-10-0-142-225 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:01:51.813316 ip-10-0-142-225 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:51.814495 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.814413 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:01:51.817996 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.817981 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818002 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818005 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818010 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818013 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818015 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818018 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818021 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818024 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818026 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818029 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.818028 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818032 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818035 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818038 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818041 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818044 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818046 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818049 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818051 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818054 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818057 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818059 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818062 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818064 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818067 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818069 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818072 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818074 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818077 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818086 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818089 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.818308 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818091 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818094 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818096 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818099 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818102 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818106 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818122 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818125 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818128 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818131 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818134 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818137 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818140 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818143 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818146 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818149 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818152 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818155 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818158 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.818792 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818160 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818164 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818166 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818169 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818172 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818175 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818178 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818180 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818183 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818185 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818188 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818190 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818193 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818195 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818197 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818200 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818204 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818208 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818210 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818213 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.819262 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818216 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818218 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818221 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818225 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818228 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818231 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818233 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818237 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818240 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818242 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818251 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818254 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818256 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818259 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818261 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818264 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818266 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818268 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818271 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818274 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.819741 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818276 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818278 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818282 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818285 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818288 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818290 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818293 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818296 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.818299 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819028 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819035 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819038 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819042 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819045 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819048 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819051 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819054 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819056 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819060 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.820232 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819063 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819066 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819069 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819071 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819074 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819077 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819080 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819082 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819085 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819088 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819090 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819093 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819095 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819098 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819100 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819103 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819105 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819108 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819110 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819113 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.820690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819116 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819119 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819121 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819124 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819126 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819129 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819131 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819134 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819136 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819139 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819141 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819144 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819147 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819149 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819152 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819155 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819157 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819160 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819163 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819166 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.821251 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819168 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819171 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819173 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819176 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819178 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819181 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819183 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819187 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819191 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819193 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819196 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819199 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819202 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819205 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819208 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819210 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819212 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819216 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819219 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.821736 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819222 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819225 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819227 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819230 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819233 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819238 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819240 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819243 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819247 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819250 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819253 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819257 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819260 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819262 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819265 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819268 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819271 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819273 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819276 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.822235 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819278 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819281 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819283 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819286 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819288 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819291 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819293 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819296 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819299 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819301 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819304 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819711 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819716 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819719 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819722 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819725 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819728 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819733 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819736 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819739 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.822777 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819742 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819745 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819747 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819767 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819772 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819776 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819779 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819782 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819785 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819787 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819790 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819793 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819796 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819798 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819800 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819803 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819806 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819809 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819811 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819814 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.823321 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819816 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819819 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819821 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819824 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819826 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819828 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819831 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819834 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819836 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819840 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819845 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819848 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819851 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819854 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819857 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819860 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819863 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819867 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819869 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819872 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.823879 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819874 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819877 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819881 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819885 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819888 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819890 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819893 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819896 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819899 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819902 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819904 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819907 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819910 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819913 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819916 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819919 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819921 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819924 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819927 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819929 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.824440 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819932 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819935 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819938 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819941 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819943 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819946 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819948 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819951 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819953 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819956 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819965 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819968 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819970 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819973 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819975 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819978 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819980 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819983 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819985 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.825004 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819988 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819990 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819993 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819996 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.819999 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820002 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820005 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820007 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820010 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820012 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820014 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820083 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820090 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820098 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820106 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820114 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820121 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820127 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820135 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820139 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:01:51.825531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820141 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820145 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820148 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820151 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820158 2561 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820161 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820164 2561 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820167 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820170 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820174 2561 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820177 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820180 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820183 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820186 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820190 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820193 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820196 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820199 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820202 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820206 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820209 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820212 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820215 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820219 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:01:51.826094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820221 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820224 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820228 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820231 2561 flags.go:64] FLAG: --enable-server="true" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820234 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820241 2561 flags.go:64] FLAG: --event-burst="100" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820245 2561 flags.go:64] FLAG: --event-qps="50" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820247 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820251 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820253 2561 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820257 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820260 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820263 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820266 2561 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820269 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820272 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820275 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820278 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820281 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820284 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820286 2561 flags.go:64] FLAG: --feature-gates="" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820290 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820293 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820295 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820299 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820302 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:01:51.826806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820305 2561 flags.go:64] FLAG: --help="false" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820308 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-225.ec2.internal" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820311 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820314 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820317 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820320 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820323 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820326 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820334 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820337 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820340 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820343 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820346 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820348 2561 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820351 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820354 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820357 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820360 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820362 2561 flags.go:64] FLAG: --lock-file="" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820365 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820369 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820372 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820377 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:01:51.827548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820380 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820383 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820386 2561 flags.go:64] FLAG: --logging-format="text" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820388 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820391 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820394 2561 flags.go:64] FLAG: --manifest-url="" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820397 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820401 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820404 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820408 2561 flags.go:64] FLAG: --max-pods="110" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820411 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820414 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820417 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820419 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820423 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820426 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820428 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820436 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820439 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820442 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820445 2561 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820448 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820453 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820456 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:01:51.828176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820459 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820462 2561 flags.go:64] FLAG: --port="10250" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820465 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820468 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-059fea25b5ca00ee6" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820471 2561 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820474 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820477 2561 flags.go:64] FLAG: --register-node="true" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820481 2561 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820484 2561 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820487 2561 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820490 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820493 2561 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820496 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820499 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820502 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820505 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820508 2561 flags.go:64] FLAG: --runonce="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820510 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820513 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820516 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820519 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820522 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820525 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820528 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820531 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820535 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:01:51.828770 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820538 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820541 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820543 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820546 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820549 2561 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820552 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820557 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820559 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820562 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820569 2561 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820571 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820574 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820577 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820586 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820589 2561 flags.go:64] FLAG: --v="2" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820592 2561 flags.go:64] FLAG: --version="false" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820596 2561 flags.go:64] FLAG: --vmodule="" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820600 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.820603 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820725 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820729 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820732 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820734 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820738 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.829411 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820741 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820744 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820747 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820761 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820764 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820767 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820769 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820774 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820778 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820781 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820784 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820787 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820790 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820793 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820796 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820799 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820802 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820805 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820807 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.829999 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820810 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820813 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820816 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820819 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820822 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820824 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820827 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820830 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820833 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820835 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820838 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820840 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820843 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820845 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820849 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820851 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820854 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820857 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820859 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820862 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.830491 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820865 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820868 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820871 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820873 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820875 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820878 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820881 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820883 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820886 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820888 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820891 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820893 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820896 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820898 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820901 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820904 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820907 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820909 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820912 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820915 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.830982 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820917 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820920 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820923 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820925 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820929 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820933 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820937 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820940 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820942 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820945 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820947 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820950 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820954 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820956 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820959 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820961 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820964 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820967 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820969 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820972 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.831464 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820975 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820977 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820980 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820982 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820985 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820987 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820990 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820992 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820995 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.820998 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.821000 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.821004 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.821007 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.821011 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.831977 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.821014 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.821019 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.827858 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.827873 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.827891 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.827897 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827954 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827959 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827962 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827965 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827968 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827972 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827975 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827978 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.832315 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827981 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827983 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827986 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827988 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827991 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827994 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827996 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.827999 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828001 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828004 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828007 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828010 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828012 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828016 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828019 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828021 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828024 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828027 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828029 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828033 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.832663 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828037 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828040 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828043 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828046 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828050 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828053 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828056 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828060 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828063 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828066 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828069 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828071 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828074 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828076 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828079 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828081 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828084 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828086 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828089 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.833168 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828092 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828094 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828097 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828100 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828103 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828105 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828111 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828114 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828116 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828119 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828122 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828124 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828127 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828129 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828132 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828134 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828137 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828139 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828142 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.833655 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828145 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828148 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828150 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828167 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828170 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828173 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828176 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828179 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828182 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828185 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828188 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828191 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828193 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828196 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828199 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828209 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828213 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828216 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828219 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.834167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828222 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828225 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828228 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828231 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828234 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828237 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828240 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828242 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828245 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828248 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828251 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828253 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828256 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.828261 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828366 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:51.834624 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828371 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828374 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828377 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828379 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828382 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828385 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828387 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828390 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828393 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828396 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828398 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828401 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828403 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828406 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828408 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828411 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828414 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828416 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828418 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828421 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:51.835125 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828424 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828426 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828429 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828432 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828434 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828436 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828439 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828443 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828447 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828450 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828452 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828455 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828457 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828460 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828462 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828465 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828467 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828471 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828475 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:51.835608 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828478 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828480 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828483 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828486 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828489 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828491 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828494 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828496 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828499 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828501 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828504 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828506 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828509 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828512 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828514 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828517 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828519 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828522 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828524 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828527 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:51.836099 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828529 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828532 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828534 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828537 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828540 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828542 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828544 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828547 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828550 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828552 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828555 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828557 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828559 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828562 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828564 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828567 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828569 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828573 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828576 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:51.836573 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828579 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828583 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828586 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828588 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828591 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828594 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828596 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828599 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828601 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828604 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828607 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828609 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828612 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828614 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828616 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828619 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828622 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828624 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828627 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:51.837045 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:51.828629 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.828634 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.828729 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.831789 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.833405 2561 server.go:1019] "Starting client certificate rotation" Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.833500 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.834073 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:01:51.837543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.836055 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:01:51.841555 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.841534 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:01:51.852598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.852577 2561 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:01:51.855050 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.855036 2561 log.go:25] "Validated CRI v1 image API" Jun 07 16:01:51.855889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.855860 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:01:51.861894 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.861876 2561 fs.go:135] Filesystem UUIDs: map[325c1917-a845-4689-8daa-1671049625ad:/dev/nvme0n1p3 77cf27bc-f63c-4a8b-98c7-e232b88160b4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 07 16:01:51.861970 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.861894 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:01:51.863252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.863235 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:01:51.866163 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.866054 2561 manager.go:216] Machine: {Timestamp:2026-06-07 16:01:51.865567769 +0000 UTC m=+0.343017454 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088649 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2711d8d473f4d93febdacf04c1b5c0 SystemUUID:ec2711d8-d473-f4d9-3feb-dacf04c1b5c0 BootID:794e47a7-1d63-4e27-8938-445f28abe591 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:53:68:63:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:53:68:63:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:49:a8:9c:ad:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:01:51.866163 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.866155 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:01:51.866291 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.866265 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:01:51.869350 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.869325 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:01:51.869478 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.869352 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:01:51.870158 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.870147 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:01:51.870189 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.870160 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:01:51.870189 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.870167 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:01:51.870189 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.870178 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:01:51.871013 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.871003 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:01:51.873844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873833 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:01:51.873946 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873937 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:01:51.873987 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873966 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:01:51.873987 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873976 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:01:51.873987 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873986 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:01:51.874094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.873996 2561 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:01:51.874094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.874011 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:01:51.874355 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.874345 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:01:51.874388 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.874364 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:01:51.877365 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.877341 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:01:51.878846 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.878831 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:01:51.878921 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.878862 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:01:51.880691 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880677 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880700 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880710 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880715 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880725 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880731 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880739 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880744 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880763 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880770 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880779 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:01:51.880778 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.880784 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:01:51.881631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.881618 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:01:51.881631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.881628 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:01:51.883823 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.883799 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:01:51.883889 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.883823 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:01:51.883889 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.883848 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:01:51.884786 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.884773 2561 server.go:1268] "Started kubelet" Jun 07 16:01:51.884888 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.884858 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:01:51.884986 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.884859 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:01:51.888989 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.888963 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:01:51.889067 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.889039 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l88d" Jun 07 16:01:51.889610 ip-10-0-142-225 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:01:51.891148 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.891067 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:01:51.891148 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.891135 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:01:51.894191 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.894174 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l88d" Jun 07 16:01:51.895826 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.895809 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:01:51.897153 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897136 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:01:51.897153 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897150 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:01:51.897282 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.897228 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:51.897697 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897678 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:01:51.897806 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897793 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:01:51.897861 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897808 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:01:51.897937 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897923 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:01:51.897937 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.897937 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:01:51.898482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898465 2561 factory.go:55] Registering systemd factory Jun 07 16:01:51.898482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898481 2561 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:01:51.898712 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898694 2561 factory.go:153] Registering CRI-O factory Jun 07 16:01:51.898712 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898711 2561 factory.go:223] Registration of the crio container factory successfully Jun 07 16:01:51.898853 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898777 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:01:51.898853 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898802 2561 factory.go:103] Registering Raw factory Jun 07 16:01:51.898853 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.898815 2561 manager.go:1196] Started watching for new ooms in manager Jun 07 16:01:51.899227 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.899215 2561 manager.go:349] Starting recovery of all containers Jun 07 16:01:51.903956 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.903936 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:51.908121 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.908099 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-225.ec2.internal\" not found" node="ip-10-0-142-225.ec2.internal" Jun 07 16:01:51.909669 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.909652 2561 manager.go:354] Recovery completed Jun 07 16:01:51.913712 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.913700 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:51.915919 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.915816 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:51.915919 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.915842 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:51.915919 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.915856 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:51.916383 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.916371 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:01:51.916383 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.916381 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:51.916461 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.916382 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:01:51.916461 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.916406 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:01:51.917000 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.916986 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:51.917073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.917012 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:51.917073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.917025 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:51.917470 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.917458 2561 policy_none.go:49] "None policy: Start" Jun 07 16:01:51.917505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.917475 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:01:51.917505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.917485 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:01:51.918559 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.918548 2561 policy_none.go:47] "Start" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954033 2561 manager.go:337] "Starting Device Plugin manager" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.954069 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954078 2561 server.go:87] "Starting device plugin registration server" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954268 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954280 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954356 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954431 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.954439 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.955610 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.955656 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.961288 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.962358 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.962388 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.962407 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:51.962468 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 16:01:51.965783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:51.964462 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:52.054413 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.054372 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:52.055235 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.055220 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:52.055314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.055246 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:52.055314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.055259 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:52.055314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.055283 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.063215 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.063198 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal"] Jun 07 16:01:52.063288 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.063251 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:52.064322 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.064282 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.064322 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.064299 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-225.ec2.internal\": node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.064485 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.064472 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:52.064540 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.064495 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:52.064540 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.064504 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:52.065939 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.065926 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:52.066056 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.066119 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066076 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:52.066672 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066652 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:52.066672 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066665 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:52.066855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066679 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:52.066855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066685 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:52.066855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066693 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:52.066855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.066696 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:52.067901 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.067884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.067978 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.067910 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:52.068595 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.068581 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:52.068676 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.068609 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:52.068676 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.068624 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:52.078164 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.078148 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.096275 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.096258 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-225.ec2.internal\" not found" node="ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.098357 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.098342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.098436 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.098371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.098436 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.098395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7f5e21ad719a7119be8c23253c6d35-config\") pod \"kube-apiserver-proxy-ip-10-0-142-225.ec2.internal\" (UID: \"9c7f5e21ad719a7119be8c23253c6d35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.100702 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.100686 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-225.ec2.internal\" not found" node="ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.179218 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.179201 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.198863 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.198926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.198926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7f5e21ad719a7119be8c23253c6d35-config\") pod \"kube-apiserver-proxy-ip-10-0-142-225.ec2.internal\" (UID: \"9c7f5e21ad719a7119be8c23253c6d35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.198926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7f5e21ad719a7119be8c23253c6d35-config\") pod \"kube-apiserver-proxy-ip-10-0-142-225.ec2.internal\" (UID: \"9c7f5e21ad719a7119be8c23253c6d35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.199065 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.199065 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.198963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ee102c8772665cd0d64108c87ed264-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal\" (UID: \"24ee102c8772665cd0d64108c87ed264\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.279868 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.279836 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.380547 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.380490 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.400874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.400856 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.405418 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.405402 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:52.480999 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.480961 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.581447 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.581411 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.681989 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.681930 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.782516 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.782383 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.808129 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.808112 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:52.833041 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.833018 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:01:52.833598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.833197 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:01:52.833598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.833191 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:01:52.833598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.833198 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:01:52.883556 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:52.883527 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-225.ec2.internal\" not found" Jun 07 16:01:52.898786 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.898744 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 15:56:51 +0000 UTC" deadline="2027-12-24 11:03:19.041991456 +0000 UTC" Jun 07 16:01:52.898786 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.898784 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13555h1m26.143210756s" Jun 07 16:01:52.938156 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:52.937418 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ee102c8772665cd0d64108c87ed264.slice/crio-5c5b18552b19d9daad16b284bc9dde8f8449625e88a13dc41a1efa56489a3e4a WatchSource:0}: Error finding container 5c5b18552b19d9daad16b284bc9dde8f8449625e88a13dc41a1efa56489a3e4a: Status 404 returned error can't find the container with id 5c5b18552b19d9daad16b284bc9dde8f8449625e88a13dc41a1efa56489a3e4a Jun 07 16:01:52.938342 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:52.938319 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7f5e21ad719a7119be8c23253c6d35.slice/crio-0a22662dcfb29b7d1708358a69bfeecd784573f7c6c740676d048fc7c6fa6af8 WatchSource:0}: Error finding container 0a22662dcfb29b7d1708358a69bfeecd784573f7c6c740676d048fc7c6fa6af8: Status 404 returned error can't find the container with id 0a22662dcfb29b7d1708358a69bfeecd784573f7c6c740676d048fc7c6fa6af8 Jun 07 16:01:52.942786 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.942768 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:52.944848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.944835 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:01:52.965814 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.965774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" event={"ID":"24ee102c8772665cd0d64108c87ed264","Type":"ContainerStarted","Data":"5c5b18552b19d9daad16b284bc9dde8f8449625e88a13dc41a1efa56489a3e4a"} Jun 07 16:01:52.966712 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.966691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" event={"ID":"9c7f5e21ad719a7119be8c23253c6d35","Type":"ContainerStarted","Data":"0a22662dcfb29b7d1708358a69bfeecd784573f7c6c740676d048fc7c6fa6af8"} Jun 07 16:01:52.997736 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:52.997714 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" Jun 07 16:01:53.007881 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.007863 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:01:53.009176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.009165 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" Jun 07 16:01:53.018355 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.018343 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:01:53.784416 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.784385 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:53.792449 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.792425 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:53.874510 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.874479 2561 apiserver.go:52] "Watching apiserver" Jun 07 16:01:53.884622 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.884598 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:01:53.884950 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.884920 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ztwzc","openshift-image-registry/node-ca-xghb2","openshift-multus/multus-wwj4k","openshift-network-operator/iptables-alerter-trpbz","openshift-ovn-kubernetes/ovnkube-node-sxnjj","kube-system/konnectivity-agent-g7pnr","kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj","openshift-cluster-node-tuning-operator/tuned-6nlq4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal","openshift-multus/multus-additional-cni-plugins-r9f5v","openshift-multus/network-metrics-daemon-p4cg9","openshift-network-diagnostics/network-check-target-bg5v5","kube-system/global-pull-secret-syncer-gqvzf"] Jun 07 16:01:53.887457 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.887432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:53.887567 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:53.887513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:01:53.889359 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.889341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:53.891402 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.891381 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.891603 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.891583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.891603 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.891595 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.891719 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.891607 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-btzl6\"" Jun 07 16:01:53.891785 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.891581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:01:53.893318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.893301 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:53.893730 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.893711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:01:53.894051 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.894036 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.894143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.894121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hczk\"" Jun 07 16:01:53.894350 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.894331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:01:53.894426 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.894361 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.895328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.895309 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.895505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.895486 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.895590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.895572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:01:53.895643 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.895585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.896098 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.896066 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jwwmx\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.897475 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.897736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.897771 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.897890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fn4f\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.897940 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.898059 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.898101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.898161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:53.898205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.898162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:01:53.900493 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.900061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:53.900593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.900498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qdpkw\"" Jun 07 16:01:53.900593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.900512 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:01:53.900593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.900562 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:01:53.902311 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.902292 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pxff5\"" Jun 07 16:01:53.902396 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.902349 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.902532 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.902520 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.902639 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.902621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:53.904668 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.904651 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:53.905248 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.905217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pzbl9\"" Jun 07 16:01:53.905332 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.905310 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.905462 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.905220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.905535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.905448 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:01:53.906963 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.906946 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:01:53.907053 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.906951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vmpq4\"" Jun 07 16:01:53.907053 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.906998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:53.907220 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:53.907104 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:01:53.907220 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907210 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:01:53.907345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-hostroot\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.907345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29012174-8469-4ff0-a814-eb9af59a41e4-iptables-alerter-script\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:53.907345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-systemd-units\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-netns\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-netd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-script-lib\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-konnectivity-ca\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzbpb\" (UniqueName: \"kubernetes.io/projected/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-kube-api-access-mzbpb\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-systemd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-log-socket\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-bin\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-system-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-multus-certs\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.907594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.908088 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.907628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-ovn\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.908088 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f9efe49-aec9-436c-a867-662fc831ee21-ovn-node-metrics-cert\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.908088 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-serviceca\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:53.908211 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-bin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.908211 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-kubelet\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.908301 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-daemon-config\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.908301 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-etc-kubernetes\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.908401 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29012174-8469-4ff0-a814-eb9af59a41e4-host-slash\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:53.908401 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.908509 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-os-release\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.908509 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:53.908509 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86h2d\" (UniqueName: \"kubernetes.io/projected/29012174-8469-4ff0-a814-eb9af59a41e4-kube-api-access-86h2d\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:53.908651 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.908509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-node-log\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pfgk\" (UniqueName: \"kubernetes.io/projected/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-kube-api-access-6pfgk\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cnibin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-k8s-cni-cncf-io\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d71f77c-0e9d-4536-905f-d6a121d02940-hosts-file\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d71f77c-0e9d-4536-905f-d6a121d02940-tmp-dir\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-slash\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-config\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-agent-certs\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cni-binary-copy\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-conf-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwp7h\" (UniqueName: \"kubernetes.io/projected/8d71f77c-0e9d-4536-905f-d6a121d02940-kube-api-access-rwp7h\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-var-lib-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-env-overrides\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-host\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-netns\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.911261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-kubelet\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-etc-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9cx\" (UniqueName: \"kubernetes.io/projected/7f9efe49-aec9-436c-a867-662fc831ee21-kube-api-access-fv9cx\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-socket-dir-parent\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.909728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-multus\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.910187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:53.912182 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.910359 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:01:53.912589 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.912572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:01:53.912638 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.912622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qlsqc\"" Jun 07 16:01:53.912671 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.912644 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:53.912702 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:53.912690 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:01:53.912734 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.912572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:01:53.928655 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.928636 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xkz7h" Jun 07 16:01:53.936076 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.936061 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xkz7h" Jun 07 16:01:53.998687 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:53.998666 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:01:54.009917 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.009894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-kubernetes\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.010034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.009930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-log-socket\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.009956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-bin\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.009982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-kubelet-config\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.010034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-ovn\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-log-socket\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-serviceca\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-bin\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-bin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-ovn\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-systemd\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-bin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29012174-8469-4ff0-a814-eb9af59a41e4-host-slash\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-os-release\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010265 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29012174-8469-4ff0-a814-eb9af59a41e4-host-slash\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-os-release\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2d\" (UniqueName: \"kubernetes.io/projected/29012174-8469-4ff0-a814-eb9af59a41e4-kube-api-access-86h2d\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pfgk\" (UniqueName: \"kubernetes.io/projected/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-kube-api-access-6pfgk\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cnibin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-k8s-cni-cncf-io\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010521 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-serviceca\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d71f77c-0e9d-4536-905f-d6a121d02940-tmp-dir\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-tmp\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cnibin\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-sys-fs\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h82g\" (UniqueName: \"kubernetes.io/projected/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-kube-api-access-2h82g\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-k8s-cni-cncf-io\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-config\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-agent-certs\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cni-binary-copy\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.010822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwp7h\" (UniqueName: \"kubernetes.io/projected/8d71f77c-0e9d-4536-905f-d6a121d02940-kube-api-access-rwp7h\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010836 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d71f77c-0e9d-4536-905f-d6a121d02940-tmp-dir\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-registration-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-var-lib-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-env-overrides\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-host\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-netns\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-kubelet\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.010988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-etc-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-systemd-units\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-netns\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-netd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-script-lib\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-konnectivity-ca\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-os-release\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.011620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwzg\" (UniqueName: \"kubernetes.io/projected/ace2547a-7d1a-426f-85c3-88b3a3129a2c-kube-api-access-2pwzg\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-systemd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-etc-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-host\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011339 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-systemd-units\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011377 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-netns\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-kubelet\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-netns\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-config\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-cni-netd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011488 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-run-systemd\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-env-overrides\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-var-lib-openvswitch\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-system-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-multus-certs\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.012463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-etc-kubernetes\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphtk\" (UniqueName: \"kubernetes.io/projected/68062aaa-4876-4f0c-aff1-48740581bf18-kube-api-access-wphtk\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-dbus\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f9efe49-aec9-436c-a867-662fc831ee21-ovnkube-script-lib\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.011997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-cni-binary-copy\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f9efe49-aec9-436c-a867-662fc831ee21-ovn-node-metrics-cert\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-kubelet\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-daemon-config\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-sys\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-var-lib-kubelet\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-etc-tuned\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thnq4\" (UniqueName: \"kubernetes.io/projected/501490cc-ffdc-4a62-8358-b1e1274a5a13-kube-api-access-thnq4\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-node-log\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.013304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-modprobe-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysconfig\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-conf\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-host\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-slash\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-conf-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-socket-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-device-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-run\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012488 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-konnectivity-ca\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-etc-kubernetes\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9cx\" (UniqueName: \"kubernetes.io/projected/7f9efe49-aec9-436c-a867-662fc831ee21-kube-api-access-fv9cx\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-system-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-socket-dir-parent\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012671 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-socket-dir-parent\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-slash\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012718 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-kubelet\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-cni-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-host-run-ovn-kubernetes\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-conf-dir\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-run-multus-certs\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f9efe49-aec9-436c-a867-662fc831ee21-node-log\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-multus\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.012984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-hostroot\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-host-var-lib-cni-multus\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-lib-modules\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-hostroot\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-multus-daemon-config\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29012174-8469-4ff0-a814-eb9af59a41e4-iptables-alerter-script\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzbpb\" (UniqueName: \"kubernetes.io/projected/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-kube-api-access-mzbpb\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.014867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cnibin\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.015808 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d71f77c-0e9d-4536-905f-d6a121d02940-hosts-file\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.015808 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.013633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29012174-8469-4ff0-a814-eb9af59a41e4-iptables-alerter-script\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.015808 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.014174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d71f77c-0e9d-4536-905f-d6a121d02940-hosts-file\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.015808 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.015030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f9efe49-aec9-436c-a867-662fc831ee21-ovn-node-metrics-cert\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.015808 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.015071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bff93d1f-02ad-48d7-ad1a-97aa53e5d962-agent-certs\") pod \"konnectivity-agent-g7pnr\" (UID: \"bff93d1f-02ad-48d7-ad1a-97aa53e5d962\") " pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:54.017864 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.017841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pfgk\" (UniqueName: \"kubernetes.io/projected/a70cfa9b-a6e0-437f-8ab7-5799ffc61281-kube-api-access-6pfgk\") pod \"node-ca-xghb2\" (UID: \"a70cfa9b-a6e0-437f-8ab7-5799ffc61281\") " pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.018139 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.018121 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:54.018139 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.018140 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:54.018273 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.018151 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:54.018273 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.018219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:01:54.518198116 +0000 UTC m=+2.995647780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:54.018394 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.018312 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86h2d\" (UniqueName: \"kubernetes.io/projected/29012174-8469-4ff0-a814-eb9af59a41e4-kube-api-access-86h2d\") pod \"iptables-alerter-trpbz\" (UID: \"29012174-8469-4ff0-a814-eb9af59a41e4\") " pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.018447 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.018434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwp7h\" (UniqueName: \"kubernetes.io/projected/8d71f77c-0e9d-4536-905f-d6a121d02940-kube-api-access-rwp7h\") pod \"node-resolver-ztwzc\" (UID: \"8d71f77c-0e9d-4536-905f-d6a121d02940\") " pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.020265 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.020223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9cx\" (UniqueName: \"kubernetes.io/projected/7f9efe49-aec9-436c-a867-662fc831ee21-kube-api-access-fv9cx\") pod \"ovnkube-node-sxnjj\" (UID: \"7f9efe49-aec9-436c-a867-662fc831ee21\") " pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.020614 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.020597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzbpb\" (UniqueName: \"kubernetes.io/projected/98de7dbe-a7b6-4c0f-8d5f-c051df5905a5-kube-api-access-mzbpb\") pod \"multus-wwj4k\" (UID: \"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5\") " pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.114063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.113991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphtk\" (UniqueName: \"kubernetes.io/projected/68062aaa-4876-4f0c-aff1-48740581bf18-kube-api-access-wphtk\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-dbus\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.114063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-sys\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-var-lib-kubelet\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-etc-tuned\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-dbus\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thnq4\" (UniqueName: \"kubernetes.io/projected/501490cc-ffdc-4a62-8358-b1e1274a5a13-kube-api-access-thnq4\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-modprobe-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-sys\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-var-lib-kubelet\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysconfig\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-modprobe-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.114315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-conf\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-host\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114342 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysconfig\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114360 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114385 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-host\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-socket-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-system-cni-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-device-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-conf\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-run\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-lib-modules\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-device-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-run\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115063 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cnibin\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-kubernetes\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-kubelet-config\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-lib-modules\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-socket-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-systemd\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-kubernetes\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-kubelet-config\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cnibin\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-tmp\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-systemd\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.114895 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-sys-fs\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.115813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h82g\" (UniqueName: \"kubernetes.io/projected/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-kube-api-access-2h82g\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.114958 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:54.614938389 +0000 UTC m=+3.092388052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-registration-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-os-release\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.114901 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwzg\" (UniqueName: \"kubernetes.io/projected/ace2547a-7d1a-426f-85c3-88b3a3129a2c-kube-api-access-2pwzg\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.115138 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:54.615121389 +0000 UTC m=+3.092571064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-registration-dir\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.114995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/501490cc-ffdc-4a62-8358-b1e1274a5a13-sys-fs\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ace2547a-7d1a-426f-85c3-88b3a3129a2c-os-release\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68062aaa-4876-4f0c-aff1-48740581bf18-etc-sysctl-d\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.116298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.115595 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ace2547a-7d1a-426f-85c3-88b3a3129a2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.116996 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.116973 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-etc-tuned\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.117079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.117063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68062aaa-4876-4f0c-aff1-48740581bf18-tmp\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.125336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.125315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwzg\" (UniqueName: \"kubernetes.io/projected/ace2547a-7d1a-426f-85c3-88b3a3129a2c-kube-api-access-2pwzg\") pod \"multus-additional-cni-plugins-r9f5v\" (UID: \"ace2547a-7d1a-426f-85c3-88b3a3129a2c\") " pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.125336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.125329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thnq4\" (UniqueName: \"kubernetes.io/projected/501490cc-ffdc-4a62-8358-b1e1274a5a13-kube-api-access-thnq4\") pod \"aws-ebs-csi-driver-node-zb6bj\" (UID: \"501490cc-ffdc-4a62-8358-b1e1274a5a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.126237 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.126209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphtk\" (UniqueName: \"kubernetes.io/projected/68062aaa-4876-4f0c-aff1-48740581bf18-kube-api-access-wphtk\") pod \"tuned-6nlq4\" (UID: \"68062aaa-4876-4f0c-aff1-48740581bf18\") " pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.126398 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.126381 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h82g\" (UniqueName: \"kubernetes.io/projected/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-kube-api-access-2h82g\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.201365 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.201334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xghb2" Jun 07 16:01:54.208712 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.208688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwj4k" Jun 07 16:01:54.219414 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.219396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-trpbz" Jun 07 16:01:54.223976 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.223961 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:01:54.231472 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.231450 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:01:54.236987 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.236970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztwzc" Jun 07 16:01:54.243537 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.243515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" Jun 07 16:01:54.250048 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.250030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" Jun 07 16:01:54.254598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.254583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" Jun 07 16:01:54.519107 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.519044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:54.519223 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.519180 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:54.519223 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.519195 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:54.519223 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.519204 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:54.519365 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.519248 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:01:55.519236054 +0000 UTC m=+3.996685715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:54.619727 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.619696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.619727 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.619732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.619925 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.619851 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:54.619925 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.619855 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:54.619925 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.619901 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:55.619888751 +0000 UTC m=+4.097338413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:54.619925 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.619913 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:55.619907195 +0000 UTC m=+4.097356856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:54.796063 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.796026 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68062aaa_4876_4f0c_aff1_48740581bf18.slice/crio-a1a90fea9a53520cc2fb54f8ced79fdd715688477015c1f27a4a1975f13bf9e3 WatchSource:0}: Error finding container a1a90fea9a53520cc2fb54f8ced79fdd715688477015c1f27a4a1975f13bf9e3: Status 404 returned error can't find the container with id a1a90fea9a53520cc2fb54f8ced79fdd715688477015c1f27a4a1975f13bf9e3 Jun 07 16:01:54.797562 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.797525 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501490cc_ffdc_4a62_8358_b1e1274a5a13.slice/crio-bf9b97c72f1b1e39ceeee463c33990a03a33618b10c581a50d1c70af592d31bc WatchSource:0}: Error finding container bf9b97c72f1b1e39ceeee463c33990a03a33618b10c581a50d1c70af592d31bc: Status 404 returned error can't find the container with id bf9b97c72f1b1e39ceeee463c33990a03a33618b10c581a50d1c70af592d31bc Jun 07 16:01:54.801100 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.801079 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d71f77c_0e9d_4536_905f_d6a121d02940.slice/crio-11645e533bc7995cf71fdfb49522b9cdc3f085642d7f0f446bbea3fae2edde6f WatchSource:0}: Error finding container 11645e533bc7995cf71fdfb49522b9cdc3f085642d7f0f446bbea3fae2edde6f: Status 404 returned error can't find the container with id 11645e533bc7995cf71fdfb49522b9cdc3f085642d7f0f446bbea3fae2edde6f Jun 07 16:01:54.802504 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.802478 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff93d1f_02ad_48d7_ad1a_97aa53e5d962.slice/crio-d32af07553fc0b27397e135da6c796e55ffc58eb1cf8a929dd767dec9726e7ef WatchSource:0}: Error finding container d32af07553fc0b27397e135da6c796e55ffc58eb1cf8a929dd767dec9726e7ef: Status 404 returned error can't find the container with id d32af07553fc0b27397e135da6c796e55ffc58eb1cf8a929dd767dec9726e7ef Jun 07 16:01:54.803167 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.803122 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70cfa9b_a6e0_437f_8ab7_5799ffc61281.slice/crio-c806a089a9a7211d0b6819ea7a00e3bd5b17418f6a6cfd6e37630c020024bb8e WatchSource:0}: Error finding container c806a089a9a7211d0b6819ea7a00e3bd5b17418f6a6cfd6e37630c020024bb8e: Status 404 returned error can't find the container with id c806a089a9a7211d0b6819ea7a00e3bd5b17418f6a6cfd6e37630c020024bb8e Jun 07 16:01:54.804423 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.804399 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29012174_8469_4ff0_a814_eb9af59a41e4.slice/crio-b15259f5c949064c493d11d8f286ad400d6648f77e13a5377371e0699da85307 WatchSource:0}: Error finding container b15259f5c949064c493d11d8f286ad400d6648f77e13a5377371e0699da85307: Status 404 returned error can't find the container with id b15259f5c949064c493d11d8f286ad400d6648f77e13a5377371e0699da85307 Jun 07 16:01:54.805718 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.805703 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9efe49_aec9_436c_a867_662fc831ee21.slice/crio-8edcce2d73f4a9bee3be0ac4a794595a4e9c1799b91e065bd7cc80bf66fb7050 WatchSource:0}: Error finding container 8edcce2d73f4a9bee3be0ac4a794595a4e9c1799b91e065bd7cc80bf66fb7050: Status 404 returned error can't find the container with id 8edcce2d73f4a9bee3be0ac4a794595a4e9c1799b91e065bd7cc80bf66fb7050 Jun 07 16:01:54.826436 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.826412 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98de7dbe_a7b6_4c0f_8d5f_c051df5905a5.slice/crio-9219a465f51edfdddbf4f97fba1bf47db9aa07f4d7cdbda78e118f2df3ede038 WatchSource:0}: Error finding container 9219a465f51edfdddbf4f97fba1bf47db9aa07f4d7cdbda78e118f2df3ede038: Status 404 returned error can't find the container with id 9219a465f51edfdddbf4f97fba1bf47db9aa07f4d7cdbda78e118f2df3ede038 Jun 07 16:01:54.827801 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:01:54.827784 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace2547a_7d1a_426f_85c3_88b3a3129a2c.slice/crio-2e7c802682e8dcca4e3570f7b55a6c9a46d0e957066155d5ae7398f8b6075517 WatchSource:0}: Error finding container 2e7c802682e8dcca4e3570f7b55a6c9a46d0e957066155d5ae7398f8b6075517: Status 404 returned error can't find the container with id 2e7c802682e8dcca4e3570f7b55a6c9a46d0e957066155d5ae7398f8b6075517 Jun 07 16:01:54.939856 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.939818 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:56:53 +0000 UTC" deadline="2027-11-10 17:04:04.382014375 +0000 UTC" Jun 07 16:01:54.939856 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.939853 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12505h2m9.442165251s" Jun 07 16:01:54.963214 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.963185 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:54.963356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.963222 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:54.963356 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.963320 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:01:54.963491 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:54.963466 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:01:54.971252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.971228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" event={"ID":"9c7f5e21ad719a7119be8c23253c6d35","Type":"ContainerStarted","Data":"4d2c62b534f140c50a6df231a9a66841fb6004e859ac21d6aab0066a198b641e"} Jun 07 16:01:54.975033 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.975008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwj4k" event={"ID":"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5","Type":"ContainerStarted","Data":"9219a465f51edfdddbf4f97fba1bf47db9aa07f4d7cdbda78e118f2df3ede038"} Jun 07 16:01:54.976137 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.976117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"8edcce2d73f4a9bee3be0ac4a794595a4e9c1799b91e065bd7cc80bf66fb7050"} Jun 07 16:01:54.977040 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.977022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7pnr" event={"ID":"bff93d1f-02ad-48d7-ad1a-97aa53e5d962","Type":"ContainerStarted","Data":"d32af07553fc0b27397e135da6c796e55ffc58eb1cf8a929dd767dec9726e7ef"} Jun 07 16:01:54.978006 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.977987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztwzc" event={"ID":"8d71f77c-0e9d-4536-905f-d6a121d02940","Type":"ContainerStarted","Data":"11645e533bc7995cf71fdfb49522b9cdc3f085642d7f0f446bbea3fae2edde6f"} Jun 07 16:01:54.979033 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.979013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" event={"ID":"68062aaa-4876-4f0c-aff1-48740581bf18","Type":"ContainerStarted","Data":"a1a90fea9a53520cc2fb54f8ced79fdd715688477015c1f27a4a1975f13bf9e3"} Jun 07 16:01:54.980153 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.980129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerStarted","Data":"2e7c802682e8dcca4e3570f7b55a6c9a46d0e957066155d5ae7398f8b6075517"} Jun 07 16:01:54.981146 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.981126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-trpbz" event={"ID":"29012174-8469-4ff0-a814-eb9af59a41e4","Type":"ContainerStarted","Data":"b15259f5c949064c493d11d8f286ad400d6648f77e13a5377371e0699da85307"} Jun 07 16:01:54.982152 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.982128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xghb2" event={"ID":"a70cfa9b-a6e0-437f-8ab7-5799ffc61281","Type":"ContainerStarted","Data":"c806a089a9a7211d0b6819ea7a00e3bd5b17418f6a6cfd6e37630c020024bb8e"} Jun 07 16:01:54.983149 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.983128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" event={"ID":"501490cc-ffdc-4a62-8358-b1e1274a5a13","Type":"ContainerStarted","Data":"bf9b97c72f1b1e39ceeee463c33990a03a33618b10c581a50d1c70af592d31bc"} Jun 07 16:01:54.986355 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:54.986319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-225.ec2.internal" podStartSLOduration=1.9863081299999998 podStartE2EDuration="1.98630813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:01:54.986187229 +0000 UTC m=+3.463636914" watchObservedRunningTime="2026-06-07 16:01:54.98630813 +0000 UTC m=+3.463757812" Jun 07 16:01:55.511265 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.511155 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:55.526978 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.526945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:55.527176 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.527158 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:55.527244 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.527185 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:55.527244 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.527199 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:55.527340 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.527258 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.527237259 +0000 UTC m=+6.004686939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:55.628095 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.627841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:55.628276 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.628119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:55.628276 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.628261 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:55.628384 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.628338 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.628316539 +0000 UTC m=+6.105766204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:55.628773 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.628733 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:55.628911 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.628893 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.628875098 +0000 UTC m=+6.106324778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:55.941079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.940971 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:56:53 +0000 UTC" deadline="2028-01-07 14:04:42.823441284 +0000 UTC" Jun 07 16:01:55.941079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.941033 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13894h2m46.882412843s" Jun 07 16:01:55.965745 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:55.965717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:55.965907 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:55.965857 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:01:56.006777 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:56.006550 2561 generic.go:356] "Generic (PLEG): container finished" podID="24ee102c8772665cd0d64108c87ed264" containerID="92ffa27cdc553957ebba6b3c5156181b9f14fe8584fa97ea2ee0f9fdb6ce2bc1" exitCode=0 Jun 07 16:01:56.007677 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:56.007586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" event={"ID":"24ee102c8772665cd0d64108c87ed264","Type":"ContainerDied","Data":"92ffa27cdc553957ebba6b3c5156181b9f14fe8584fa97ea2ee0f9fdb6ce2bc1"} Jun 07 16:01:56.963392 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:56.962742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:56.963392 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:56.962899 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:01:56.963392 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:56.962978 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:56.963392 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:56.963064 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:01:57.018936 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:57.018481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" event={"ID":"24ee102c8772665cd0d64108c87ed264","Type":"ContainerStarted","Data":"7dcc33db093f20c6ae3e32b8de2d6c13332f7be1ae7585c4dcb81ac9496de4f2"} Jun 07 16:01:57.543598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:57.543558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:57.543807 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.543789 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:57.543876 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.543840 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:57.543876 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.543858 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:57.543979 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.543924 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:01.543904314 +0000 UTC m=+10.021354009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:57.644111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:57.644073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:57.644276 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:57.644128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:57.644332 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.644292 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:57.644379 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.644353 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:01.644333643 +0000 UTC m=+10.121783324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:57.644736 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.644718 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:57.644860 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.644782 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:01.644766413 +0000 UTC m=+10.122216079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:57.962951 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:57.962866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:57.963106 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:57.963001 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:01:58.963313 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:58.963278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:01:58.963784 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:58.963324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:01:58.963784 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:58.963433 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:01:58.963784 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:58.963540 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:01:59.963094 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:01:59.963064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:01:59.963257 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:01:59.963198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:00.962727 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:00.962630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:00.963203 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:00.962667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:00.963203 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:00.962870 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:00.963203 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:00.963007 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:01.580848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:01.580807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:01.581059 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.580975 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:01.581059 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.581000 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:01.581059 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.581015 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:01.581234 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.581080 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:09.581060266 +0000 UTC m=+18.058509944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:01.681197 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:01.681154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:01.681374 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:01.681213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:01.681374 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.681370 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:01.681463 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.681431 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:09.681413403 +0000 UTC m=+18.158863067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:01.681920 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.681895 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:01.682004 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.681964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:09.681945414 +0000 UTC m=+18.159395094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:01.965126 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:01.965051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:01.966067 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:01.965702 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:02.963337 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:02.963300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:02.963337 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:02.963324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:02.963581 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:02.963442 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:02.963638 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:02.963573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:03.962819 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:03.962785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:03.963261 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:03.962904 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:04.963482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:04.963446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:04.964023 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:04.963614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:04.964023 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:04.963710 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:04.964023 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:04.963562 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:05.963269 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:05.963235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:05.963456 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:05.963371 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:06.963123 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:06.963094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:06.963123 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:06.963124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:06.963606 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:06.963219 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:06.963606 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:06.963302 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:07.963512 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:07.963484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:07.964072 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:07.963609 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:08.963737 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:08.963639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:08.963737 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:08.963656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:08.964368 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:08.963789 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:08.964368 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:08.963854 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:09.642398 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:09.642356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:09.642586 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.642515 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:09.642586 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.642531 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:09.642586 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.642542 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:09.642771 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.642598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.642579376 +0000 UTC m=+34.120029053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:09.743769 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:09.743707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:09.743769 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:09.743774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:09.744013 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.743881 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:09.744013 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.743964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.743942264 +0000 UTC m=+34.221391939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:09.744013 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.743888 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:09.744168 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.744034 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.744015982 +0000 UTC m=+34.221465650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:09.963103 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:09.963019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:09.963267 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:09.963196 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:10.962966 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:10.962927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:10.963571 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:10.962927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:10.963571 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:10.963065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:10.963571 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:10.963207 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:11.964139 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:11.964103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:11.967247 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:11.964212 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:12.963159 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:12.963122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:12.963318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:12.963162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:12.963318 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:12.963232 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:12.963392 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:12.963335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:13.963058 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:13.962808 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:13.963556 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:13.963095 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:14.065947 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.065707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwj4k" event={"ID":"98de7dbe-a7b6-4c0f-8d5f-c051df5905a5","Type":"ContainerStarted","Data":"b0660b5740755a3b8ba7fab949241905db2fd346ebceccbfbb730129f39f87e1"} Jun 07 16:02:14.068832 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.068806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:02:14.069162 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069135 2561 generic.go:356] "Generic (PLEG): container finished" podID="7f9efe49-aec9-436c-a867-662fc831ee21" containerID="6ecca0e06315659eaa723d130a2ef7fdde22ff13820574066177df71fa345ba8" exitCode=1 Jun 07 16:02:14.069281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"fc7aa811e413fb42347b36b86f62ff5110a7a532849e783a88c307b7cefe6be1"} Jun 07 16:02:14.069281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"e84f3cccb91500e63cf7e3b1839e2e38b51a083ed36b3c9a7e3aeaacf01de6f4"} Jun 07 16:02:14.069389 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069295 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"37dfb476a6edcd6f922de33ddc7ddc0acbc9b5e71bb46b6b15cdec1239c62b28"} Jun 07 16:02:14.069389 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"2b80588a4c39e18dec23cd02106b23b6153361befe213b9e97c0023d9af1ade9"} Jun 07 16:02:14.069389 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerDied","Data":"6ecca0e06315659eaa723d130a2ef7fdde22ff13820574066177df71fa345ba8"} Jun 07 16:02:14.069538 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.069415 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"4a9ff7a966d544c837fc1603f881338452afc664e10114a58ac6721475dd5e0a"} Jun 07 16:02:14.070774 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.070734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7pnr" event={"ID":"bff93d1f-02ad-48d7-ad1a-97aa53e5d962","Type":"ContainerStarted","Data":"208ecf72f4b7a9ba05938efe9b7f439ad39164a3b2f4aadfb1d481a9c04140dc"} Jun 07 16:02:14.072252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.072209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztwzc" event={"ID":"8d71f77c-0e9d-4536-905f-d6a121d02940","Type":"ContainerStarted","Data":"154101085b51de1bb5bbe2b6fc446dc198a5ef500a724d6b6a2a776d650bb71b"} Jun 07 16:02:14.073963 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.073937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" event={"ID":"68062aaa-4876-4f0c-aff1-48740581bf18","Type":"ContainerStarted","Data":"3ba9b98e1db4d1b2358436339f4213c64c8bccb2aea030b8c0a99713d90b284c"} Jun 07 16:02:14.075694 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.075610 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="1c6a6c085bce1f5a203072cdc55de67c1a3932ef94c5b68e6cdc21c04a8c8ce6" exitCode=0 Jun 07 16:02:14.075805 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.075690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"1c6a6c085bce1f5a203072cdc55de67c1a3932ef94c5b68e6cdc21c04a8c8ce6"} Jun 07 16:02:14.077505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.077490 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xghb2" event={"ID":"a70cfa9b-a6e0-437f-8ab7-5799ffc61281","Type":"ContainerStarted","Data":"4e4e25cad21b78f84960a513618eccf045ca9f580d887fc8cb8a94f8fec1eed7"} Jun 07 16:02:14.078996 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.078973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" event={"ID":"501490cc-ffdc-4a62-8358-b1e1274a5a13","Type":"ContainerStarted","Data":"3e7af45916b6a9a0c6bad7c1e02badb0ebd63d0e89799274530909a7e3ee21b3"} Jun 07 16:02:14.081532 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.081490 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-225.ec2.internal" podStartSLOduration=21.081473516 podStartE2EDuration="21.081473516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:01:57.033820135 +0000 UTC m=+5.511269819" watchObservedRunningTime="2026-06-07 16:02:14.081473516 +0000 UTC m=+22.558923201" Jun 07 16:02:14.081875 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.081845 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wwj4k" podStartSLOduration=3.444453106 podStartE2EDuration="22.081839577s" totalImagesPullingTime="18.637386471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:14.081163819 +0000 UTC m=+22.558613502" watchObservedRunningTime="2026-06-07 16:02:14.081839577 +0000 UTC m=+22.559289259" Jun 07 16:02:14.097657 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.097618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ztwzc" podStartSLOduration=3.788559701 podStartE2EDuration="22.097606061s" totalImagesPullingTime="18.30904636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:14.097189049 +0000 UTC m=+22.574638732" watchObservedRunningTime="2026-06-07 16:02:14.097606061 +0000 UTC m=+22.575055741" Jun 07 16:02:14.130366 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.130311 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6nlq4" podStartSLOduration=3.73947778 podStartE2EDuration="22.130293117s" totalImagesPullingTime="18.390815337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:14.130243536 +0000 UTC m=+22.607693220" watchObservedRunningTime="2026-06-07 16:02:14.130293117 +0000 UTC m=+22.607742802" Jun 07 16:02:14.144408 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.144364 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xghb2" podStartSLOduration=3.781901329 podStartE2EDuration="22.144346824s" totalImagesPullingTime="18.362445495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:14.14402199 +0000 UTC m=+22.621471673" watchObservedRunningTime="2026-06-07 16:02:14.144346824 +0000 UTC m=+22.621796507" Jun 07 16:02:14.159326 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.159266 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g7pnr" podStartSLOduration=3.851828463 podStartE2EDuration="22.1592542s" totalImagesPullingTime="18.307425737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:14.158941212 +0000 UTC m=+22.636390894" watchObservedRunningTime="2026-06-07 16:02:14.1592542 +0000 UTC m=+22.636703882" Jun 07 16:02:14.192300 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.192273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:02:14.192782 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.192745 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:02:14.324847 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.324100 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:02:14.963231 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.963203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:14.963931 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.963240 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:14.963931 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:14.963322 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:14.963931 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:14.963426 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:14.966284 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.966192 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:02:14.324120321Z","UUID":"4517c704-d87f-432f-8059-0091be5f756e","Handler":null,"Name":"","Endpoint":""} Jun 07 16:02:14.967889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.967772 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:02:14.967889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:14.967815 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:02:15.083065 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:15.082988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-trpbz" event={"ID":"29012174-8469-4ff0-a814-eb9af59a41e4","Type":"ContainerStarted","Data":"235d3144cc089bcaf17a0a91873f0c34b32962d9f05a1226ff02098a07009c70"} Jun 07 16:02:15.085071 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:15.085036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" event={"ID":"501490cc-ffdc-4a62-8358-b1e1274a5a13","Type":"ContainerStarted","Data":"336ddb94bff3ce46b4b2b429b47e883f4c3ed5f57e8a9b618e000c2e9856e471"} Jun 07 16:02:15.097371 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:15.097282 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-trpbz" podStartSLOduration=4.728464814 podStartE2EDuration="23.097268622s" totalImagesPullingTime="18.368803808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:15.096833033 +0000 UTC m=+23.574282721" watchObservedRunningTime="2026-06-07 16:02:15.097268622 +0000 UTC m=+23.574718305" Jun 07 16:02:15.963530 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:15.963499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:15.964178 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:15.963623 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:16.090723 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:16.090685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" event={"ID":"501490cc-ffdc-4a62-8358-b1e1274a5a13","Type":"ContainerStarted","Data":"f0a66a21eb1dbbdb8d0032c949330eae40577596d320a69fb3dded09c4ed4a0c"} Jun 07 16:02:16.090994 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:16.090971 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 07 16:02:16.119552 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:16.119489 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb6bj" podStartSLOduration=3.896501833 podStartE2EDuration="24.119462838s" totalImagesPullingTime="20.222961005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:16.119187025 +0000 UTC m=+24.596636711" watchObservedRunningTime="2026-06-07 16:02:16.119462838 +0000 UTC m=+24.596912516" Jun 07 16:02:16.962673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:16.962642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:16.962869 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:16.962770 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:16.962869 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:16.962782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:16.962975 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:16.962880 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:17.096152 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:17.096120 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:02:17.096624 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:17.096542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"04d72e91a46023ebb8ef2d7af9b646dff5502e47d44e86425c8bb3ea97b7f62d"} Jun 07 16:02:17.963080 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:17.963048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:17.963233 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:17.963157 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:18.963235 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:18.963001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:18.963703 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:18.963059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:18.963703 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:18.963265 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:18.963703 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:18.963323 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:19.103619 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.103593 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:02:19.104007 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.103985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"026a3683a2028ee68c731a414e882c1edfde28246aa43923091236bcfd78553c"} Jun 07 16:02:19.104243 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.104220 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:19.104481 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.104464 2561 scope.go:117] "RemoveContainer" containerID="6ecca0e06315659eaa723d130a2ef7fdde22ff13820574066177df71fa345ba8" Jun 07 16:02:19.106034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.106007 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="c865a8cdd0aea1b1bdf739ed7da344e741e45df6cff61e40147873da4bce1c02" exitCode=0 Jun 07 16:02:19.106114 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.106053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"c865a8cdd0aea1b1bdf739ed7da344e741e45df6cff61e40147873da4bce1c02"} Jun 07 16:02:19.120507 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.120489 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:19.962985 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:19.962834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:19.963150 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:19.963054 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:20.113232 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.113210 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:02:20.113673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.113621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" event={"ID":"7f9efe49-aec9-436c-a867-662fc831ee21","Type":"ContainerStarted","Data":"8bf5d9b3b41e3684175844adff6c2e7c0db000b72aa42e99c0ab8b9fa923f9f7"} Jun 07 16:02:20.114014 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.113992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:20.114149 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.114074 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:20.130056 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.130035 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:20.140537 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.140495 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" podStartSLOduration=9.749333857 podStartE2EDuration="28.140477293s" totalImagesPullingTime="18.391143436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:20.138939312 +0000 UTC m=+28.616388994" watchObservedRunningTime="2026-06-07 16:02:20.140477293 +0000 UTC m=+28.617926976" Jun 07 16:02:20.354792 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.354762 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqvzf"] Jun 07 16:02:20.354960 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.354864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:20.354960 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:20.354941 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:20.358259 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.358151 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bg5v5"] Jun 07 16:02:20.358259 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.358244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:20.358444 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:20.358338 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:20.358851 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.358830 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4cg9"] Jun 07 16:02:20.359065 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:20.358918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:20.359065 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:20.359002 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:21.120378 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.120345 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="cbe8afa56fcc8d9e598912d7c1f49d46e51229af11fbedffd4fb3be3b6c6ead1" exitCode=0 Jun 07 16:02:21.121074 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.120431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"cbe8afa56fcc8d9e598912d7c1f49d46e51229af11fbedffd4fb3be3b6c6ead1"} Jun 07 16:02:21.945145 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.945113 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:02:21.945331 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.945249 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 07 16:02:21.945707 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.945691 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g7pnr" Jun 07 16:02:21.963825 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.963797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:21.963825 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.963810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:21.963998 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:21.963919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:21.963998 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:21.963922 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:21.964105 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:21.964014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:21.964157 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:21.964115 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:23.127446 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:23.127413 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="664e4c6a1258f6650ed35fee1dd0453b14d81224b42b37834e9bb97f7d3a73b5" exitCode=0 Jun 07 16:02:23.127881 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:23.127463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"664e4c6a1258f6650ed35fee1dd0453b14d81224b42b37834e9bb97f7d3a73b5"} Jun 07 16:02:23.963073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:23.962871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:23.963256 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:23.962871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:23.963256 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:23.963171 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:23.963382 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:23.962940 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:23.963382 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:23.963266 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:23.963478 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:23.963385 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:25.661196 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.661161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:25.661609 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.661364 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:25.661609 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.661389 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:25.661609 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.661403 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jf6nx for pod openshift-network-diagnostics/network-check-target-bg5v5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.661609 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.661470 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx podName:a5eb5de2-f87e-416a-b6c3-920c0836d85f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:57.661451119 +0000 UTC m=+66.138900796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6nx" (UniqueName: "kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx") pod "network-check-target-bg5v5" (UID: "a5eb5de2-f87e-416a-b6c3-920c0836d85f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.762231 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.762194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:25.762231 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.762241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:25.762470 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.762362 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.762470 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.762375 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.762470 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.762434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret podName:ff626d0a-5d3e-4883-a4bd-f5f660aed8b8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:57.762418084 +0000 UTC m=+66.239867761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret") pod "global-pull-secret-syncer-gqvzf" (UID: "ff626d0a-5d3e-4883-a4bd-f5f660aed8b8") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.762470 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.762452 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:57.762444633 +0000 UTC m=+66.239894294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.963406 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.963354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:25.963561 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.963487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:25.963634 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.963490 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bg5v5" podUID="a5eb5de2-f87e-416a-b6c3-920c0836d85f" Jun 07 16:02:25.963634 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.963599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqvzf" podUID="ff626d0a-5d3e-4883-a4bd-f5f660aed8b8" Jun 07 16:02:25.963634 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:25.963613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:25.963806 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:25.963736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:02:26.327318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.327274 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-225.ec2.internal" event="NodeReady" Jun 07 16:02:26.327501 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.327435 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:02:26.373091 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.373059 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x7s9s"] Jun 07 16:02:26.400397 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.400359 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6nnxv"] Jun 07 16:02:26.400554 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.400494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.403061 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.403039 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:02:26.403200 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.403039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:02:26.403263 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.403204 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:02:26.414940 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.414915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7s9s"] Jun 07 16:02:26.415061 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.414962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6nnxv"] Jun 07 16:02:26.415061 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.415003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.417585 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.417468 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:02:26.417585 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.417481 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:02:26.417585 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.417469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:02:26.417585 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.417575 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h275w\"" Jun 07 16:02:26.569237 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3f89795-9eed-4f27-9f14-f200db67859f-cert\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.569412 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e350eb-133a-4a0b-88e9-d044d171136e-tmp-dir\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.569412 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.569412 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgh7g\" (UniqueName: \"kubernetes.io/projected/b8e350eb-133a-4a0b-88e9-d044d171136e-kube-api-access-vgh7g\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.569412 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb7qv\" (UniqueName: \"kubernetes.io/projected/d3f89795-9eed-4f27-9f14-f200db67859f-kube-api-access-vb7qv\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.569588 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.569472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e350eb-133a-4a0b-88e9-d044d171136e-config-volume\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e350eb-133a-4a0b-88e9-d044d171136e-tmp-dir\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:26.670187 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgh7g\" (UniqueName: \"kubernetes.io/projected/b8e350eb-133a-4a0b-88e9-d044d171136e-kube-api-access-vgh7g\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:26.670248 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:27.170229901 +0000 UTC m=+35.647679585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb7qv\" (UniqueName: \"kubernetes.io/projected/d3f89795-9eed-4f27-9f14-f200db67859f-kube-api-access-vb7qv\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e350eb-133a-4a0b-88e9-d044d171136e-config-volume\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3f89795-9eed-4f27-9f14-f200db67859f-cert\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.670586 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e350eb-133a-4a0b-88e9-d044d171136e-tmp-dir\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.670964 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.670920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8e350eb-133a-4a0b-88e9-d044d171136e-config-volume\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.675215 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.675183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3f89795-9eed-4f27-9f14-f200db67859f-cert\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.679149 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.679123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb7qv\" (UniqueName: \"kubernetes.io/projected/d3f89795-9eed-4f27-9f14-f200db67859f-kube-api-access-vb7qv\") pod \"ingress-canary-6nnxv\" (UID: \"d3f89795-9eed-4f27-9f14-f200db67859f\") " pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:26.679902 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.679876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgh7g\" (UniqueName: \"kubernetes.io/projected/b8e350eb-133a-4a0b-88e9-d044d171136e-kube-api-access-vgh7g\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:26.724811 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:26.724770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6nnxv" Jun 07 16:02:27.075787 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.075743 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6nnxv"] Jun 07 16:02:27.079234 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:02:27.079210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f89795_9eed_4f27_9f14_f200db67859f.slice/crio-9da20322ce6cd7877505f524c606d76b211ffa9fdd78487f2967c3df5f084af3 WatchSource:0}: Error finding container 9da20322ce6cd7877505f524c606d76b211ffa9fdd78487f2967c3df5f084af3: Status 404 returned error can't find the container with id 9da20322ce6cd7877505f524c606d76b211ffa9fdd78487f2967c3df5f084af3 Jun 07 16:02:27.138168 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.137951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6nnxv" event={"ID":"d3f89795-9eed-4f27-9f14-f200db67859f","Type":"ContainerStarted","Data":"9da20322ce6cd7877505f524c606d76b211ffa9fdd78487f2967c3df5f084af3"} Jun 07 16:02:27.141146 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.141113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerStarted","Data":"e3c64b74ac5ef500985f087855e5e4bb027dfa4369bf340486e5e5c119af0c5a"} Jun 07 16:02:27.174080 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.174051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:27.174191 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:27.174173 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:27.174241 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:27.174232 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:28.174216687 +0000 UTC m=+36.651666352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:27.963556 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.963479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:27.963968 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.963479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:27.964027 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.963479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:27.967054 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.967023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:02:27.967259 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.967135 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:02:27.968111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.968091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:02:27.968111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.968104 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:02:27.968279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.968119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:02:27.968279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:27.968186 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:02:28.145654 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:28.145624 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="e3c64b74ac5ef500985f087855e5e4bb027dfa4369bf340486e5e5c119af0c5a" exitCode=0 Jun 07 16:02:28.145822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:28.145690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"e3c64b74ac5ef500985f087855e5e4bb027dfa4369bf340486e5e5c119af0c5a"} Jun 07 16:02:28.179959 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:28.179934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:28.180086 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:28.180069 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:28.180141 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:28.180130 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:30.180113154 +0000 UTC m=+38.657562815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:29.151170 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:29.151139 2561 generic.go:356] "Generic (PLEG): container finished" podID="ace2547a-7d1a-426f-85c3-88b3a3129a2c" containerID="692af44ec6573dffee3afbd22c5b4f5f8d77d6f26c8c652ccf4ad5ff08170a92" exitCode=0 Jun 07 16:02:29.151607 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:29.151183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerDied","Data":"692af44ec6573dffee3afbd22c5b4f5f8d77d6f26c8c652ccf4ad5ff08170a92"} Jun 07 16:02:30.154494 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:30.154464 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6nnxv" event={"ID":"d3f89795-9eed-4f27-9f14-f200db67859f","Type":"ContainerStarted","Data":"e0a2f87adae7e11795902337bdc007066c1993e125781c01615984b9fedacfaf"} Jun 07 16:02:30.157728 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:30.157703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" event={"ID":"ace2547a-7d1a-426f-85c3-88b3a3129a2c","Type":"ContainerStarted","Data":"e9dd9638b0bae70c739799e70b4bd27099ebefe73736cad15b341728d43efe5c"} Jun 07 16:02:30.168595 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:30.168552 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6nnxv" podStartSLOduration=1.986173434 podStartE2EDuration="4.168538818s" totalImagesPullingTime="2.182365384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:30.167872173 +0000 UTC m=+38.645321856" watchObservedRunningTime="2026-06-07 16:02:30.168538818 +0000 UTC m=+38.645988501" Jun 07 16:02:30.187983 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:30.187888 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9f5v" podStartSLOduration=9.602020675 podStartE2EDuration="38.187874135s" totalImagesPullingTime="28.58585346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:30.186881088 +0000 UTC m=+38.664330772" watchObservedRunningTime="2026-06-07 16:02:30.187874135 +0000 UTC m=+38.665323821" Jun 07 16:02:30.196847 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:30.196825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:30.196947 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:30.196935 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:30.196994 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:30.196980 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:34.196969591 +0000 UTC m=+42.674419256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:34.227186 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:34.227152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:34.227593 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:34.227278 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:34.227593 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:34.227342 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:42.22732799 +0000 UTC m=+50.704777650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:42.283522 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:42.283486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:42.284034 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:42.283628 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:42.284034 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:42.283700 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:02:58.283684602 +0000 UTC m=+66.761134262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:02:52.132855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:52.132829 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sxnjj" Jun 07 16:02:57.681225 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.681172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:57.683609 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.683585 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:02:57.693611 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.693593 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:02:57.705704 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.705684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6nx\" (UniqueName: \"kubernetes.io/projected/a5eb5de2-f87e-416a-b6c3-920c0836d85f-kube-api-access-jf6nx\") pod \"network-check-target-bg5v5\" (UID: \"a5eb5de2-f87e-416a-b6c3-920c0836d85f\") " pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:57.782318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.782286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:57.782318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.782320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:02:57.784744 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.784724 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:02:57.784798 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.784732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:02:57.792665 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:57.792652 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:02:57.792723 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:57.792714 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:04:01.792699862 +0000 UTC m=+130.270149523 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : secret "metrics-daemon-secret" not found Jun 07 16:02:57.794896 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.794867 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff626d0a-5d3e-4883-a4bd-f5f660aed8b8-original-pull-secret\") pod \"global-pull-secret-syncer-gqvzf\" (UID: \"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8\") " pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:57.977920 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.977846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:02:57.985945 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.985920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:02:57.988226 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:57.988211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqvzf" Jun 07 16:02:58.119274 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:58.119245 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqvzf"] Jun 07 16:02:58.122123 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:02:58.122096 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff626d0a_5d3e_4883_a4bd_f5f660aed8b8.slice/crio-9234867f39d34e171b40c7ac992c516c061a34c668ecbdc320a18902c09d6ef0 WatchSource:0}: Error finding container 9234867f39d34e171b40c7ac992c516c061a34c668ecbdc320a18902c09d6ef0: Status 404 returned error can't find the container with id 9234867f39d34e171b40c7ac992c516c061a34c668ecbdc320a18902c09d6ef0 Jun 07 16:02:58.133831 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:58.133788 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bg5v5"] Jun 07 16:02:58.137690 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:02:58.137664 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eb5de2_f87e_416a_b6c3_920c0836d85f.slice/crio-bc82a4fff868de6a48a660d30051e1141e6bce4ae7bac6eb364651e7acb131ce WatchSource:0}: Error finding container bc82a4fff868de6a48a660d30051e1141e6bce4ae7bac6eb364651e7acb131ce: Status 404 returned error can't find the container with id bc82a4fff868de6a48a660d30051e1141e6bce4ae7bac6eb364651e7acb131ce Jun 07 16:02:58.223192 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:58.223159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqvzf" event={"ID":"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8","Type":"ContainerStarted","Data":"9234867f39d34e171b40c7ac992c516c061a34c668ecbdc320a18902c09d6ef0"} Jun 07 16:02:58.224203 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:58.224172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bg5v5" event={"ID":"a5eb5de2-f87e-416a-b6c3-920c0836d85f","Type":"ContainerStarted","Data":"bc82a4fff868de6a48a660d30051e1141e6bce4ae7bac6eb364651e7acb131ce"} Jun 07 16:02:58.285788 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:02:58.285725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:02:58.285926 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:58.285872 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:58.285965 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:02:58.285934 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:03:30.285918769 +0000 UTC m=+98.763368429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:03:03.240393 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:03.240252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqvzf" event={"ID":"ff626d0a-5d3e-4883-a4bd-f5f660aed8b8","Type":"ContainerStarted","Data":"1b5fc4c8d9a4c7e84f4e88d2cddb604648dfb854a8aad8954e6f4a863b7d1759"} Jun 07 16:03:03.241682 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:03.241658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bg5v5" event={"ID":"a5eb5de2-f87e-416a-b6c3-920c0836d85f","Type":"ContainerStarted","Data":"bde99f625a345f35792fd53e725066bf386222dc4ef3a73ffdb177dfc2aa2533"} Jun 07 16:03:03.241821 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:03.241798 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:03:03.253909 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:03.253863 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gqvzf" podStartSLOduration=66.968291934 podStartE2EDuration="1m11.253845059s" totalImagesPullingTime="4.285553125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:03.253440825 +0000 UTC m=+71.730890509" watchObservedRunningTime="2026-06-07 16:03:03.253845059 +0000 UTC m=+71.731294723" Jun 07 16:03:03.267293 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:03.267253 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bg5v5" podStartSLOduration=67.000889126 podStartE2EDuration="1m11.267241021s" totalImagesPullingTime="4.266351895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:03.266291345 +0000 UTC m=+71.743741029" watchObservedRunningTime="2026-06-07 16:03:03.267241021 +0000 UTC m=+71.744690701" Jun 07 16:03:30.307797 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:30.307764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:03:30.308319 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:03:30.307917 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:30.308319 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:03:30.307999 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:04:34.307978639 +0000 UTC m=+162.785428314 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:03:34.247560 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:03:34.247529 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bg5v5" Jun 07 16:04:01.813299 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:04:01.813257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:04:01.813808 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:01.813382 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:04:01.813808 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:01.813437 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs podName:8fdfd12b-1bd4-4e73-9733-b442cc7ae310 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:03.813421409 +0000 UTC m=+252.290871073 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs") pod "network-metrics-daemon-p4cg9" (UID: "8fdfd12b-1bd4-4e73-9733-b442cc7ae310") : secret "metrics-daemon-secret" not found Jun 07 16:04:29.412617 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:29.412571 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7s9s" podUID="b8e350eb-133a-4a0b-88e9-d044d171136e" Jun 07 16:04:29.439671 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:04:29.439643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:04:30.981837 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:30.981791 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p4cg9" podUID="8fdfd12b-1bd4-4e73-9733-b442cc7ae310" Jun 07 16:04:34.334045 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:04:34.333957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:04:34.334499 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:34.334070 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:04:34.334499 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:04:34.334142 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls podName:b8e350eb-133a-4a0b-88e9-d044d171136e nodeName:}" failed. No retries permitted until 2026-06-07 16:06:36.334120519 +0000 UTC m=+284.811570183 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls") pod "dns-default-x7s9s" (UID: "b8e350eb-133a-4a0b-88e9-d044d171136e") : secret "dns-default-metrics-tls" not found Jun 07 16:04:42.962997 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:04:42.962948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:05:34.043157 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.043013 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-9b4rp"] Jun 07 16:05:34.044878 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.044862 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml"] Jun 07 16:05:34.045018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.044999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.046593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.046574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.048081 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.048061 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 07 16:05:34.048179 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.048082 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 07 16:05:34.048317 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.048293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.048502 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.048488 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xtfz5\"" Jun 07 16:05:34.048581 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.048533 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.049194 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.049179 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pchfl\"" Jun 07 16:05:34.049482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.049469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 07 16:05:34.049630 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.049617 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 07 16:05:34.054018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.054000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 07 16:05:34.058181 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.058119 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml"] Jun 07 16:05:34.063454 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.063430 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-9b4rp"] Jun 07 16:05:34.119161 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-service-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.119161 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-snapshots\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.119329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.119329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-trusted-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.119329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-serving-cert\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.119329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg69k\" (UniqueName: \"kubernetes.io/projected/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-kube-api-access-hg69k\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.119453 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/463232c7-9d2a-4a33-8a33-a368f5a3d668-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.119453 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.119409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-tmp\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.135203 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.135179 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf"] Jun 07 16:05:34.137100 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.137085 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" Jun 07 16:05:34.139205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.139187 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.139278 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.139200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rmprs\"" Jun 07 16:05:34.139278 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.139209 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.142017 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.141997 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45"] Jun 07 16:05:34.143824 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.143804 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2"] Jun 07 16:05:34.144011 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.143990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.145748 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.145726 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65c47c7fcf-9wjrs"] Jun 07 16:05:34.145857 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.145826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.146481 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.146465 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.146628 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.146610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 07 16:05:34.146731 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.146718 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.146919 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.146733 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 07 16:05:34.146919 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.146847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p84sh\"" Jun 07 16:05:34.147589 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.147574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.149791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.149773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf"] Jun 07 16:05:34.150700 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.150681 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 07 16:05:34.150924 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.150906 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.151005 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.150951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 07 16:05:34.151796 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.151615 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 07 16:05:34.152022 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.151921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.152289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152270 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 07 16:05:34.152392 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152371 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 07 16:05:34.152495 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.152619 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h752j\"" Jun 07 16:05:34.152720 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152686 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 07 16:05:34.152934 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152912 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.153016 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.152951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cdw6t\"" Jun 07 16:05:34.159331 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.159298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45"] Jun 07 16:05:34.160110 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.160089 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2"] Jun 07 16:05:34.165696 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.165678 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65c47c7fcf-9wjrs"] Jun 07 16:05:34.220620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-snapshots\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.220783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshxs\" (UniqueName: \"kubernetes.io/projected/b8c93f94-63c5-4d8a-9b70-48358a2781ad-kube-api-access-hshxs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.220783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpg59\" (UniqueName: \"kubernetes.io/projected/f2873b35-d559-41a9-9e1e-037cf45e35aa-kube-api-access-lpg59\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.220783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.220783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-stats-auth\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.220783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-trusted-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.220790 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-serving-cert\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg69k\" (UniqueName: \"kubernetes.io/projected/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-kube-api-access-hg69k\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.220849 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.720830141 +0000 UTC m=+223.198279834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-default-certificate\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86phg\" (UniqueName: \"kubernetes.io/projected/2ecc9de3-f034-4971-b936-8adc69379c14-kube-api-access-86phg\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.220971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9966\" (UniqueName: \"kubernetes.io/projected/5a74ede8-17ad-40f4-8415-9302f45cc25f-kube-api-access-q9966\") pod \"volume-data-source-validator-78dd696465-fslrf\" (UID: \"5a74ede8-17ad-40f4-8415-9302f45cc25f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.220988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/463232c7-9d2a-4a33-8a33-a368f5a3d668-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c93f94-63c5-4d8a-9b70-48358a2781ad-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-tmp\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2873b35-d559-41a9-9e1e-037cf45e35aa-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c93f94-63c5-4d8a-9b70-48358a2781ad-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-service-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2873b35-d559-41a9-9e1e-037cf45e35aa-config\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.221345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-snapshots\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.221697 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221448 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-tmp\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.221826 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221807 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/463232c7-9d2a-4a33-8a33-a368f5a3d668-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.221870 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-service-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.221985 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.221970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-trusted-ca-bundle\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.223216 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.223200 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-serving-cert\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.231869 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.231847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg69k\" (UniqueName: \"kubernetes.io/projected/11a9ee97-bde3-418a-8b63-a19aacd8c4ec-kube-api-access-hg69k\") pod \"insights-operator-896549976-9b4rp\" (UID: \"11a9ee97-bde3-418a-8b63-a19aacd8c4ec\") " pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.236089 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.236068 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx"] Jun 07 16:05:34.238450 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.238437 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.240864 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.240843 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.240986 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.240870 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.241304 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.241287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-csngk\"" Jun 07 16:05:34.241483 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.241469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 07 16:05:34.241567 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.241547 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 07 16:05:34.248782 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.248744 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx"] Jun 07 16:05:34.322343 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-default-certificate\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.322343 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.322343 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86phg\" (UniqueName: \"kubernetes.io/projected/2ecc9de3-f034-4971-b936-8adc69379c14-kube-api-access-86phg\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.322343 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9966\" (UniqueName: \"kubernetes.io/projected/5a74ede8-17ad-40f4-8415-9302f45cc25f-kube-api-access-q9966\") pod \"volume-data-source-validator-78dd696465-fslrf\" (UID: \"5a74ede8-17ad-40f4-8415-9302f45cc25f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c93f94-63c5-4d8a-9b70-48358a2781ad-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c93f94-63c5-4d8a-9b70-48358a2781ad-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8z9l\" (UniqueName: \"kubernetes.io/projected/aa688ab4-904b-46a4-b760-d0c23a520618-kube-api-access-g8z9l\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.322491 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpg59\" (UniqueName: \"kubernetes.io/projected/f2873b35-d559-41a9-9e1e-037cf45e35aa-kube-api-access-lpg59\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.322564 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.82254022 +0000 UTC m=+223.299989884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:34.322673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-stats-auth\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hshxs\" (UniqueName: \"kubernetes.io/projected/b8c93f94-63c5-4d8a-9b70-48358a2781ad-kube-api-access-hshxs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2873b35-d559-41a9-9e1e-037cf45e35aa-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa688ab4-904b-46a4-b760-d0c23a520618-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.322942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2873b35-d559-41a9-9e1e-037cf45e35aa-config\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.323122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.323023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c93f94-63c5-4d8a-9b70-48358a2781ad-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.323420 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.323206 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.823187543 +0000 UTC m=+223.300637207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:34.323559 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.323514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2873b35-d559-41a9-9e1e-037cf45e35aa-config\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.325066 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.325043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-default-certificate\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.325175 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.325105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c93f94-63c5-4d8a-9b70-48358a2781ad-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.325175 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.325164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-stats-auth\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.325297 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.325278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2873b35-d559-41a9-9e1e-037cf45e35aa-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.330939 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.330907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshxs\" (UniqueName: \"kubernetes.io/projected/b8c93f94-63c5-4d8a-9b70-48358a2781ad-kube-api-access-hshxs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jxhv2\" (UID: \"b8c93f94-63c5-4d8a-9b70-48358a2781ad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.331375 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.331337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpg59\" (UniqueName: \"kubernetes.io/projected/f2873b35-d559-41a9-9e1e-037cf45e35aa-kube-api-access-lpg59\") pod \"service-ca-operator-6bc5ff68f5-5dq45\" (UID: \"f2873b35-d559-41a9-9e1e-037cf45e35aa\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.331511 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.331493 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9966\" (UniqueName: \"kubernetes.io/projected/5a74ede8-17ad-40f4-8415-9302f45cc25f-kube-api-access-q9966\") pod \"volume-data-source-validator-78dd696465-fslrf\" (UID: \"5a74ede8-17ad-40f4-8415-9302f45cc25f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" Jun 07 16:05:34.331578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.331515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86phg\" (UniqueName: \"kubernetes.io/projected/2ecc9de3-f034-4971-b936-8adc69379c14-kube-api-access-86phg\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.355444 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.355406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-9b4rp" Jun 07 16:05:34.423367 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.423338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.423505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.423378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8z9l\" (UniqueName: \"kubernetes.io/projected/aa688ab4-904b-46a4-b760-d0c23a520618-kube-api-access-g8z9l\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.423505 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.423468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa688ab4-904b-46a4-b760-d0c23a520618-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.423505 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.423478 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:34.423602 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.423536 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.923519774 +0000 UTC m=+223.400969435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:34.424174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.424154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa688ab4-904b-46a4-b760-d0c23a520618-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.431882 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.431858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8z9l\" (UniqueName: \"kubernetes.io/projected/aa688ab4-904b-46a4-b760-d0c23a520618-kube-api-access-g8z9l\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.447009 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.446985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" Jun 07 16:05:34.455590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.455571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" Jun 07 16:05:34.461692 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.461668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" Jun 07 16:05:34.479969 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.479941 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-9b4rp"] Jun 07 16:05:34.483593 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:05:34.483561 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a9ee97_bde3_418a_8b63_a19aacd8c4ec.slice/crio-9cf8814270067062fe88663d4d1e8de4f85a9b41e85b6d53ef03234ae87b3e87 WatchSource:0}: Error finding container 9cf8814270067062fe88663d4d1e8de4f85a9b41e85b6d53ef03234ae87b3e87: Status 404 returned error can't find the container with id 9cf8814270067062fe88663d4d1e8de4f85a9b41e85b6d53ef03234ae87b3e87 Jun 07 16:05:34.592481 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.589488 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf"] Jun 07 16:05:34.592481 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.590503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-9b4rp" event={"ID":"11a9ee97-bde3-418a-8b63-a19aacd8c4ec","Type":"ContainerStarted","Data":"9cf8814270067062fe88663d4d1e8de4f85a9b41e85b6d53ef03234ae87b3e87"} Jun 07 16:05:34.594069 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:05:34.594036 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a74ede8_17ad_40f4_8415_9302f45cc25f.slice/crio-cffe0b31d50e3aa02243258906a37ee5c601252bdc3b52821d50c4364f16e6c6 WatchSource:0}: Error finding container cffe0b31d50e3aa02243258906a37ee5c601252bdc3b52821d50c4364f16e6c6: Status 404 returned error can't find the container with id cffe0b31d50e3aa02243258906a37ee5c601252bdc3b52821d50c4364f16e6c6 Jun 07 16:05:34.725295 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.725257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:34.725476 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.725455 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:34.725546 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.725535 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.725514783 +0000 UTC m=+224.202964447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:34.811696 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.811657 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45"] Jun 07 16:05:34.812558 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.812535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2"] Jun 07 16:05:34.814277 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:05:34.814246 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2873b35_d559_41a9_9e1e_037cf45e35aa.slice/crio-cccbfb9727fd48a8279a42a994ecfabc1093e5a989abc6484222fa4921850155 WatchSource:0}: Error finding container cccbfb9727fd48a8279a42a994ecfabc1093e5a989abc6484222fa4921850155: Status 404 returned error can't find the container with id cccbfb9727fd48a8279a42a994ecfabc1093e5a989abc6484222fa4921850155 Jun 07 16:05:34.814831 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:05:34.814814 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c93f94_63c5_4d8a_9b70_48358a2781ad.slice/crio-ec16699329f9cb14546065381fccc764fccc1de705ded64e65efea4c73c65763 WatchSource:0}: Error finding container ec16699329f9cb14546065381fccc764fccc1de705ded64e65efea4c73c65763: Status 404 returned error can't find the container with id ec16699329f9cb14546065381fccc764fccc1de705ded64e65efea4c73c65763 Jun 07 16:05:34.825840 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.825816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.825982 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.825964 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:34.826045 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.825982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:34.826045 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.826015 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.825999728 +0000 UTC m=+224.303449392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:34.826146 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.826096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.826079395 +0000 UTC m=+224.303529061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:34.926530 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:34.926449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:34.926657 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.926551 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:34.926657 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:34.926615 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.926601141 +0000 UTC m=+224.404050802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:35.594999 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.594956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" event={"ID":"b8c93f94-63c5-4d8a-9b70-48358a2781ad","Type":"ContainerStarted","Data":"ec16699329f9cb14546065381fccc764fccc1de705ded64e65efea4c73c65763"} Jun 07 16:05:35.596504 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.596448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" event={"ID":"f2873b35-d559-41a9-9e1e-037cf45e35aa","Type":"ContainerStarted","Data":"cccbfb9727fd48a8279a42a994ecfabc1093e5a989abc6484222fa4921850155"} Jun 07 16:05:35.597702 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.597652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" event={"ID":"5a74ede8-17ad-40f4-8415-9302f45cc25f","Type":"ContainerStarted","Data":"cffe0b31d50e3aa02243258906a37ee5c601252bdc3b52821d50c4364f16e6c6"} Jun 07 16:05:35.734819 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.734720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:35.734989 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.734881 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:35.734989 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.734968 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.734945941 +0000 UTC m=+226.212395608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:35.835587 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.835549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:35.835797 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.835678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:35.835797 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.835695 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:35.835932 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.835800 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.835747048 +0000 UTC m=+226.313196709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:35.835932 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.835866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.835847451 +0000 UTC m=+226.313297116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:35.936960 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:35.936933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:35.937108 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.937086 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:35.937185 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:35.937158 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.93714021 +0000 UTC m=+226.414589875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:36.602711 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:36.602668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" event={"ID":"5a74ede8-17ad-40f4-8415-9302f45cc25f","Type":"ContainerStarted","Data":"f6338bb23db6e15ab66a57bfd252fb20a79869eff5c45d8e004826b647718abf"} Jun 07 16:05:36.616320 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:36.616265 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fslrf" podStartSLOduration=1.325773698 podStartE2EDuration="2.616250243s" totalImagesPullingTime="1.290476545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:36.616137501 +0000 UTC m=+225.093587232" watchObservedRunningTime="2026-06-07 16:05:36.616250243 +0000 UTC m=+225.093699926" Jun 07 16:05:37.751746 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:37.751657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:37.752200 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.751855 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:37.752200 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.751934 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.751912793 +0000 UTC m=+230.229362471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:37.852281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:37.852072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:37.852281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:37.852130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:37.852281 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.852222 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:37.852281 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.852277 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.852258983 +0000 UTC m=+230.329708655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:37.852557 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.852294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.852284736 +0000 UTC m=+230.329734396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:37.953026 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:37.952970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:37.953272 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.953123 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:37.953272 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:37.953193 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.953176527 +0000 UTC m=+230.430626190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:38.610940 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.610904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" event={"ID":"b8c93f94-63c5-4d8a-9b70-48358a2781ad","Type":"ContainerStarted","Data":"96561b699ddd8272877b3c96864553f3040e06fa64fa58f5bee2350fbfd1aa01"} Jun 07 16:05:38.612503 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.612476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" event={"ID":"f2873b35-d559-41a9-9e1e-037cf45e35aa","Type":"ContainerStarted","Data":"79a0791885ca5298884754a8ecb4243127982d0be3e158493f121d75e6750f1a"} Jun 07 16:05:38.614026 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.614008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-9b4rp" event={"ID":"11a9ee97-bde3-418a-8b63-a19aacd8c4ec","Type":"ContainerStarted","Data":"cb6d238562f8fe35a52e013a5e5c0a1eda82466accab668b418394f7d9ce4ed8"} Jun 07 16:05:38.626949 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.626909 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" podStartSLOduration=1.6071922600000002 podStartE2EDuration="4.626898447s" totalImagesPullingTime="3.019706187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:38.625542533 +0000 UTC m=+227.102992215" watchObservedRunningTime="2026-06-07 16:05:38.626898447 +0000 UTC m=+227.104348108" Jun 07 16:05:38.639251 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.639205 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" podStartSLOduration=1.61058783 podStartE2EDuration="4.63919077s" totalImagesPullingTime="3.02860294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:38.637897486 +0000 UTC m=+227.115347169" watchObservedRunningTime="2026-06-07 16:05:38.63919077 +0000 UTC m=+227.116640453" Jun 07 16:05:38.657531 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:38.657481 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-9b4rp" podStartSLOduration=1.303533586 podStartE2EDuration="4.65746145s" totalImagesPullingTime="3.353927864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:38.656121637 +0000 UTC m=+227.133571346" watchObservedRunningTime="2026-06-07 16:05:38.65746145 +0000 UTC m=+227.134911134" Jun 07 16:05:41.453529 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:41.453500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztwzc_8d71f77c-0e9d-4536-905f-d6a121d02940/dns-node-resolver/0.log" Jun 07 16:05:41.792298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:41.792251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:41.792467 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.792402 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:41.792467 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.792465 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.792447891 +0000 UTC m=+238.269897554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:41.893543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:41.893509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:41.893705 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:41.893575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:41.893705 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.893669 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.893652318 +0000 UTC m=+238.371101978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:41.893705 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.893687 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:41.893878 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.893736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.893720359 +0000 UTC m=+238.371170034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:41.993937 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:41.993900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:41.994085 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.994018 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:41.994085 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:41.994078 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.994061635 +0000 UTC m=+238.471511299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:42.455258 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:42.455226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xghb2_a70cfa9b-a6e0-437f-8ab7-5799ffc61281/node-ca/0.log" Jun 07 16:05:42.854772 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:42.854731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6nnxv_d3f89795-9eed-4f27-9f14-f200db67859f/serve-healthcheck-canary/0.log" Jun 07 16:05:49.856257 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:49.856212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:05:49.856675 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:49.856361 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:05:49.856675 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:49.856428 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert podName:463232c7-9d2a-4a33-8a33-a368f5a3d668 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:05.85641124 +0000 UTC m=+254.333860900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-s76ml" (UID: "463232c7-9d2a-4a33-8a33-a368f5a3d668") : secret "networking-console-plugin-cert" not found Jun 07 16:05:49.956825 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:49.956788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:49.956995 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:49.956856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:05:49.956995 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:49.956977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:05.956957417 +0000 UTC m=+254.434407093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : configmap references non-existent config key: service-ca.crt Jun 07 16:05:49.956995 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:49.956988 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:05:49.957144 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:49.957049 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs podName:2ecc9de3-f034-4971-b936-8adc69379c14 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:05.95703286 +0000 UTC m=+254.434482538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs") pod "router-default-65c47c7fcf-9wjrs" (UID: "2ecc9de3-f034-4971-b936-8adc69379c14") : secret "router-metrics-certs-default" not found Jun 07 16:05:50.058027 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:05:50.057985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:05:50.058236 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:50.058159 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:05:50.058305 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:05:50.058236 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls podName:aa688ab4-904b-46a4-b760-d0c23a520618 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:06.05821612 +0000 UTC m=+254.535665795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-whfzx" (UID: "aa688ab4-904b-46a4-b760-d0c23a520618") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:06:00.597350 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.597317 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v97mg"] Jun 07 16:06:00.600189 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.600173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.602587 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.602567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8qbl\"" Jun 07 16:06:00.603513 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.603493 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:06:00.603608 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.603521 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:06:00.614607 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.614590 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v97mg"] Jun 07 16:06:00.634223 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.634199 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-xmn48"] Jun 07 16:06:00.636003 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.635985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:00.639438 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.639418 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rjgzb\"" Jun 07 16:06:00.639680 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.639442 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 16:06:00.639931 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.639916 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 16:06:00.640127 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.640112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bdc5b94d6-fgmtl"] Jun 07 16:06:00.641799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.641778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.645303 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.645287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:06:00.647219 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.647194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:06:00.647426 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.647406 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:06:00.647533 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.647517 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2s77n\"" Jun 07 16:06:00.654932 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.654908 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:06:00.656880 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.656859 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-xmn48"] Jun 07 16:06:00.663634 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.663615 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdc5b94d6-fgmtl"] Jun 07 16:06:00.745120 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszwr\" (UniqueName: \"kubernetes.io/projected/79ca6dbc-c034-4025-b4f0-fb64f7436fff-kube-api-access-vszwr\") pod \"downloads-6657875f97-xmn48\" (UID: \"79ca6dbc-c034-4025-b4f0-fb64f7436fff\") " pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:00.745313 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-installation-pull-secrets\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745313 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-tls\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745313 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-bound-sa-token\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745313 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbrx5\" (UniqueName: \"kubernetes.io/projected/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-api-access-gbrx5\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.745466 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-trusted-ca\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745466 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6jr\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-kube-api-access-2n6jr\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745466 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fa7eb91-32e7-48e7-83a4-07ffe8855365-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.745466 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-image-registry-private-configuration\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745466 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ddd003-b1b5-457e-aef4-c79539873f6a-ca-trust-extracted\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.745673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fa7eb91-32e7-48e7-83a4-07ffe8855365-data-volume\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.745673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fa7eb91-32e7-48e7-83a4-07ffe8855365-crio-socket\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.745673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.745673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.745620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-certificates\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.846540 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbrx5\" (UniqueName: \"kubernetes.io/projected/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-api-access-gbrx5\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.846540 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-trusted-ca\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.846874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6jr\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-kube-api-access-2n6jr\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.846874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fa7eb91-32e7-48e7-83a4-07ffe8855365-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.846874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-image-registry-private-configuration\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.846874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ddd003-b1b5-457e-aef4-c79539873f6a-ca-trust-extracted\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.846874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fa7eb91-32e7-48e7-83a4-07ffe8855365-data-volume\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fa7eb91-32e7-48e7-83a4-07ffe8855365-crio-socket\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.846963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-certificates\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vszwr\" (UniqueName: \"kubernetes.io/projected/79ca6dbc-c034-4025-b4f0-fb64f7436fff-kube-api-access-vszwr\") pod \"downloads-6657875f97-xmn48\" (UID: \"79ca6dbc-c034-4025-b4f0-fb64f7436fff\") " pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-installation-pull-secrets\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-tls\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-bound-sa-token\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847484 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fa7eb91-32e7-48e7-83a4-07ffe8855365-data-volume\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847484 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ddd003-b1b5-457e-aef4-c79539873f6a-ca-trust-extracted\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847484 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847336 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fa7eb91-32e7-48e7-83a4-07ffe8855365-crio-socket\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847728 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-trusted-ca\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.847826 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.847885 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.847827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-certificates\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.849686 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.849658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-image-registry-private-configuration\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.849815 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.849683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ddd003-b1b5-457e-aef4-c79539873f6a-installation-pull-secrets\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.849862 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.849822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fa7eb91-32e7-48e7-83a4-07ffe8855365-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.849963 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.849947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-registry-tls\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.858135 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.858116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6jr\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-kube-api-access-2n6jr\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.858478 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.858454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ddd003-b1b5-457e-aef4-c79539873f6a-bound-sa-token\") pod \"image-registry-bdc5b94d6-fgmtl\" (UID: \"83ddd003-b1b5-457e-aef4-c79539873f6a\") " pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:00.858536 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.858516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbrx5\" (UniqueName: \"kubernetes.io/projected/2fa7eb91-32e7-48e7-83a4-07ffe8855365-kube-api-access-gbrx5\") pod \"insights-runtime-extractor-v97mg\" (UID: \"2fa7eb91-32e7-48e7-83a4-07ffe8855365\") " pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.858608 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.858592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszwr\" (UniqueName: \"kubernetes.io/projected/79ca6dbc-c034-4025-b4f0-fb64f7436fff-kube-api-access-vszwr\") pod \"downloads-6657875f97-xmn48\" (UID: \"79ca6dbc-c034-4025-b4f0-fb64f7436fff\") " pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:00.908245 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.908217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v97mg" Jun 07 16:06:00.945026 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.945003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:00.951598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:00.951577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:01.044710 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.044680 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v97mg"] Jun 07 16:06:01.047841 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:01.047815 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa7eb91_32e7_48e7_83a4_07ffe8855365.slice/crio-52edafe30dedd79541a0362b7c9e8aa4715f4c6997c377fdee69139daf21ba7a WatchSource:0}: Error finding container 52edafe30dedd79541a0362b7c9e8aa4715f4c6997c377fdee69139daf21ba7a: Status 404 returned error can't find the container with id 52edafe30dedd79541a0362b7c9e8aa4715f4c6997c377fdee69139daf21ba7a Jun 07 16:06:01.089941 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.089904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-xmn48"] Jun 07 16:06:01.092979 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:01.092924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ca6dbc_c034_4025_b4f0_fb64f7436fff.slice/crio-2351b70189d679434c5b01fdff52675b2db8953fb72a34581b4e104770336e2d WatchSource:0}: Error finding container 2351b70189d679434c5b01fdff52675b2db8953fb72a34581b4e104770336e2d: Status 404 returned error can't find the container with id 2351b70189d679434c5b01fdff52675b2db8953fb72a34581b4e104770336e2d Jun 07 16:06:01.109698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.109673 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdc5b94d6-fgmtl"] Jun 07 16:06:01.112532 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:01.112510 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ddd003_b1b5_457e_aef4_c79539873f6a.slice/crio-6bed1413d0310bc5bb250981607c90f09a441a5f87f2abeac4aa4912628f030b WatchSource:0}: Error finding container 6bed1413d0310bc5bb250981607c90f09a441a5f87f2abeac4aa4912628f030b: Status 404 returned error can't find the container with id 6bed1413d0310bc5bb250981607c90f09a441a5f87f2abeac4aa4912628f030b Jun 07 16:06:01.682310 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.682268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" event={"ID":"83ddd003-b1b5-457e-aef4-c79539873f6a","Type":"ContainerStarted","Data":"dfc309581f3c03d6687b6910795568708690987db177790e70ec46225613d143"} Jun 07 16:06:01.682687 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.682333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" event={"ID":"83ddd003-b1b5-457e-aef4-c79539873f6a","Type":"ContainerStarted","Data":"6bed1413d0310bc5bb250981607c90f09a441a5f87f2abeac4aa4912628f030b"} Jun 07 16:06:01.682687 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.682360 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:01.683457 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.683432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-xmn48" event={"ID":"79ca6dbc-c034-4025-b4f0-fb64f7436fff","Type":"ContainerStarted","Data":"2351b70189d679434c5b01fdff52675b2db8953fb72a34581b4e104770336e2d"} Jun 07 16:06:01.685032 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.685004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v97mg" event={"ID":"2fa7eb91-32e7-48e7-83a4-07ffe8855365","Type":"ContainerStarted","Data":"d11f17b06698c7698fc7b82a75bd83082b81aa4a83377e07839399542acfbfbf"} Jun 07 16:06:01.685136 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.685061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v97mg" event={"ID":"2fa7eb91-32e7-48e7-83a4-07ffe8855365","Type":"ContainerStarted","Data":"52edafe30dedd79541a0362b7c9e8aa4715f4c6997c377fdee69139daf21ba7a"} Jun 07 16:06:01.699073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:01.699028 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podStartSLOduration=1.699013791 podStartE2EDuration="1.699013791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:01.698598726 +0000 UTC m=+250.176048434" watchObservedRunningTime="2026-06-07 16:06:01.699013791 +0000 UTC m=+250.176463475" Jun 07 16:06:02.690926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:02.690896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v97mg" event={"ID":"2fa7eb91-32e7-48e7-83a4-07ffe8855365","Type":"ContainerStarted","Data":"257cb957aa032a78808a3b258f6614f29f0126a530d5d74a3bcf524eafa89b16"} Jun 07 16:06:03.697073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.696985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v97mg" event={"ID":"2fa7eb91-32e7-48e7-83a4-07ffe8855365","Type":"ContainerStarted","Data":"c0fe8bfcd128e42d03ac7b28802a80ee175aa816e84a22c6cc68a4fdb9ffa8df"} Jun 07 16:06:03.714702 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.714624 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v97mg" podStartSLOduration=1.574716545 podStartE2EDuration="3.714607558s" totalImagesPullingTime="2.139891013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:03.713906331 +0000 UTC m=+252.191356036" watchObservedRunningTime="2026-06-07 16:06:03.714607558 +0000 UTC m=+252.192057270" Jun 07 16:06:03.872845 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.872810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:06:03.875312 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.875266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fdfd12b-1bd4-4e73-9733-b442cc7ae310-metrics-certs\") pod \"network-metrics-daemon-p4cg9\" (UID: \"8fdfd12b-1bd4-4e73-9733-b442cc7ae310\") " pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:06:03.967820 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.966055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:06:03.973868 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:03.973846 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4cg9" Jun 07 16:06:04.111033 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:04.111006 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4cg9"] Jun 07 16:06:04.114166 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:04.114124 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fdfd12b_1bd4_4e73_9733_b442cc7ae310.slice/crio-531e65e139fdddb615bc02276d380bc57ab5a5309117dbf9aa8108e7cdb05285 WatchSource:0}: Error finding container 531e65e139fdddb615bc02276d380bc57ab5a5309117dbf9aa8108e7cdb05285: Status 404 returned error can't find the container with id 531e65e139fdddb615bc02276d380bc57ab5a5309117dbf9aa8108e7cdb05285 Jun 07 16:06:04.702604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:04.702564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4cg9" event={"ID":"8fdfd12b-1bd4-4e73-9733-b442cc7ae310","Type":"ContainerStarted","Data":"531e65e139fdddb615bc02276d380bc57ab5a5309117dbf9aa8108e7cdb05285"} Jun 07 16:06:05.708535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.708497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4cg9" event={"ID":"8fdfd12b-1bd4-4e73-9733-b442cc7ae310","Type":"ContainerStarted","Data":"a320b5782a6cae9babd46f3df3f4977b0c4b378e4f816581b9f04beafa139712"} Jun 07 16:06:05.708998 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.708560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4cg9" event={"ID":"8fdfd12b-1bd4-4e73-9733-b442cc7ae310","Type":"ContainerStarted","Data":"c0ddb731d48a60e931e86e1674625c1786d55cb4d749564e8fd140e4c10a5dbd"} Jun 07 16:06:05.725699 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.725638 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p4cg9" podStartSLOduration=252.81137517 podStartE2EDuration="4m13.725616104s" totalImagesPullingTime="914.240934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:05.724519833 +0000 UTC m=+254.201969521" watchObservedRunningTime="2026-06-07 16:06:05.725616104 +0000 UTC m=+254.203065787" Jun 07 16:06:05.890720 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.890683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:06:05.893575 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.893549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/463232c7-9d2a-4a33-8a33-a368f5a3d668-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-s76ml\" (UID: \"463232c7-9d2a-4a33-8a33-a368f5a3d668\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:06:05.991241 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.991206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:05.991401 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.991265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:05.991995 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.991964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc9de3-f034-4971-b936-8adc69379c14-service-ca-bundle\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:05.994034 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:05.994009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ecc9de3-f034-4971-b936-8adc69379c14-metrics-certs\") pod \"router-default-65c47c7fcf-9wjrs\" (UID: \"2ecc9de3-f034-4971-b936-8adc69379c14\") " pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:06.092369 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.092328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:06:06.095038 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.095013 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa688ab4-904b-46a4-b760-d0c23a520618-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-whfzx\" (UID: \"aa688ab4-904b-46a4-b760-d0c23a520618\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:06:06.164284 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.164254 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pchfl\"" Jun 07 16:06:06.172289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.172268 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" Jun 07 16:06:06.275802 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.275771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cdw6t\"" Jun 07 16:06:06.278270 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.278211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:06.311673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.311498 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml"] Jun 07 16:06:06.314267 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:06.314240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463232c7_9d2a_4a33_8a33_a368f5a3d668.slice/crio-64e095684a3be76eceeba6d92343ee7c2d2697a849f8bd22c6d39bdb60f39965 WatchSource:0}: Error finding container 64e095684a3be76eceeba6d92343ee7c2d2697a849f8bd22c6d39bdb60f39965: Status 404 returned error can't find the container with id 64e095684a3be76eceeba6d92343ee7c2d2697a849f8bd22c6d39bdb60f39965 Jun 07 16:06:06.349996 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.349962 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-csngk\"" Jun 07 16:06:06.357896 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.357870 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" Jun 07 16:06:06.429438 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.429365 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65c47c7fcf-9wjrs"] Jun 07 16:06:06.434290 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:06.434257 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecc9de3_f034_4971_b936_8adc69379c14.slice/crio-c0a41a2fec70e4ac4120b4a3212ee983c2538bec376833925a18728c2f0b7eff WatchSource:0}: Error finding container c0a41a2fec70e4ac4120b4a3212ee983c2538bec376833925a18728c2f0b7eff: Status 404 returned error can't find the container with id c0a41a2fec70e4ac4120b4a3212ee983c2538bec376833925a18728c2f0b7eff Jun 07 16:06:06.510363 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.510218 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx"] Jun 07 16:06:06.512941 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:06.512912 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa688ab4_904b_46a4_b760_d0c23a520618.slice/crio-4862d754a7f925c2bd1fa572f1ca5a2e09d7f3ae8abf85c0666458bcc5112047 WatchSource:0}: Error finding container 4862d754a7f925c2bd1fa572f1ca5a2e09d7f3ae8abf85c0666458bcc5112047: Status 404 returned error can't find the container with id 4862d754a7f925c2bd1fa572f1ca5a2e09d7f3ae8abf85c0666458bcc5112047 Jun 07 16:06:06.713367 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.713326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" event={"ID":"463232c7-9d2a-4a33-8a33-a368f5a3d668","Type":"ContainerStarted","Data":"64e095684a3be76eceeba6d92343ee7c2d2697a849f8bd22c6d39bdb60f39965"} Jun 07 16:06:06.714976 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.714947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" event={"ID":"2ecc9de3-f034-4971-b936-8adc69379c14","Type":"ContainerStarted","Data":"705973998bf74bc075b01afe7becd663cc1c4da044bcbf868af37465203fd6ab"} Jun 07 16:06:06.715117 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.714993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" event={"ID":"2ecc9de3-f034-4971-b936-8adc69379c14","Type":"ContainerStarted","Data":"c0a41a2fec70e4ac4120b4a3212ee983c2538bec376833925a18728c2f0b7eff"} Jun 07 16:06:06.716231 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.716202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" event={"ID":"aa688ab4-904b-46a4-b760-d0c23a520618","Type":"ContainerStarted","Data":"4862d754a7f925c2bd1fa572f1ca5a2e09d7f3ae8abf85c0666458bcc5112047"} Jun 07 16:06:06.733015 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:06.732970 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" podStartSLOduration=32.73295636 podStartE2EDuration="32.73295636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:06.731830818 +0000 UTC m=+255.209280505" watchObservedRunningTime="2026-06-07 16:06:06.73295636 +0000 UTC m=+255.210406043" Jun 07 16:06:07.165146 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.165112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:07.168316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.168284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.171058 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.171035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 16:06:07.171178 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.171148 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 16:06:07.171238 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.171040 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 16:06:07.171303 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.171262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 16:06:07.172185 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.172022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 16:06:07.172185 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.172132 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-48p8n\"" Jun 07 16:06:07.176736 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.176684 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:07.279020 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.278876 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:07.284030 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.283977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:07.303370 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.303515 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.303627 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h24lr\" (UniqueName: \"kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.303627 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.303788 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.303788 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.303651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405009 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.404964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405009 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405254 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405254 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h24lr\" (UniqueName: \"kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405349 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405349 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405769 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.405898 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405823 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.406051 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.405999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.408214 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.408192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.408308 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.408216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.413133 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.413113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h24lr\" (UniqueName: \"kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr\") pod \"console-56966bf7f5-bl9lh\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.481218 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.480925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:07.713199 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.713173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:07.715947 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:07.715919 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2794713f_e10d_473e_99bc_262e88e7716a.slice/crio-84e55959ed490598dbcd9d5e11b76f1d32b20c8cfb2a177a66851aa772bea48a WatchSource:0}: Error finding container 84e55959ed490598dbcd9d5e11b76f1d32b20c8cfb2a177a66851aa772bea48a: Status 404 returned error can't find the container with id 84e55959ed490598dbcd9d5e11b76f1d32b20c8cfb2a177a66851aa772bea48a Jun 07 16:06:07.724141 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.724096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" event={"ID":"463232c7-9d2a-4a33-8a33-a368f5a3d668","Type":"ContainerStarted","Data":"1a65a389ea58b377debfdd7783b1aee6f2730ca60d3068e76b58f4302f55d5d8"} Jun 07 16:06:07.726447 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.726254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56966bf7f5-bl9lh" event={"ID":"2794713f-e10d-473e-99bc-262e88e7716a","Type":"ContainerStarted","Data":"84e55959ed490598dbcd9d5e11b76f1d32b20c8cfb2a177a66851aa772bea48a"} Jun 07 16:06:07.726447 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.726303 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:07.727498 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.727458 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65c47c7fcf-9wjrs" Jun 07 16:06:07.738962 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:07.738913 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-s76ml" podStartSLOduration=32.437239128 podStartE2EDuration="33.738894761s" totalImagesPullingTime="1.301655633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:07.737369719 +0000 UTC m=+256.214819404" watchObservedRunningTime="2026-06-07 16:06:07.738894761 +0000 UTC m=+256.216344444" Jun 07 16:06:09.737882 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.737843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" event={"ID":"aa688ab4-904b-46a4-b760-d0c23a520618","Type":"ContainerStarted","Data":"9e73398bf5573a79515819ef232e9b38adb5f42175163b3df8fb6da5831e4e94"} Jun 07 16:06:09.755939 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.755890 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-whfzx" podStartSLOduration=32.92180162 podStartE2EDuration="35.755876445s" totalImagesPullingTime="2.834074825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:09.754644955 +0000 UTC m=+258.232094639" watchObservedRunningTime="2026-06-07 16:06:09.755876445 +0000 UTC m=+258.233326188" Jun 07 16:06:09.858370 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.858335 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s"] Jun 07 16:06:09.861693 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.861661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:09.864316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.864224 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 07 16:06:09.864316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.864272 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qvjkz\"" Jun 07 16:06:09.871137 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.871064 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s"] Jun 07 16:06:09.928692 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:09.928656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-28l7s\" (UID: \"a52a8d17-9285-41e0-9d34-53aecb55afdc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:10.029235 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:10.029145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-28l7s\" (UID: \"a52a8d17-9285-41e0-9d34-53aecb55afdc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:10.029462 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:10.029297 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:06:10.029462 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:10.029392 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates podName:a52a8d17-9285-41e0-9d34-53aecb55afdc nodeName:}" failed. No retries permitted until 2026-06-07 16:06:10.529371907 +0000 UTC m=+259.006821568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-28l7s" (UID: "a52a8d17-9285-41e0-9d34-53aecb55afdc") : secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:06:10.533303 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:10.533254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-28l7s\" (UID: \"a52a8d17-9285-41e0-9d34-53aecb55afdc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:10.536625 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:10.536570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a52a8d17-9285-41e0-9d34-53aecb55afdc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-28l7s\" (UID: \"a52a8d17-9285-41e0-9d34-53aecb55afdc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:10.774830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:10.774701 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:18.189605 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:18.189579 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52a8d17_9285_41e0_9d34_53aecb55afdc.slice/crio-2d6e15b72e093ae8eb4c50e4f2add00293ad72d8bb795d1e224a262f3d3b149a WatchSource:0}: Error finding container 2d6e15b72e093ae8eb4c50e4f2add00293ad72d8bb795d1e224a262f3d3b149a: Status 404 returned error can't find the container with id 2d6e15b72e093ae8eb4c50e4f2add00293ad72d8bb795d1e224a262f3d3b149a Jun 07 16:06:18.189942 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.189810 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s"] Jun 07 16:06:18.780150 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.779853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56966bf7f5-bl9lh" event={"ID":"2794713f-e10d-473e-99bc-262e88e7716a","Type":"ContainerStarted","Data":"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78"} Jun 07 16:06:18.782707 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.782637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-xmn48" event={"ID":"79ca6dbc-c034-4025-b4f0-fb64f7436fff","Type":"ContainerStarted","Data":"92ce58f23d72c74035e100bebd4a40a0bcafe0a1642b7d41f36558beb571f047"} Jun 07 16:06:18.783062 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.782987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:18.786024 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.785997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" event={"ID":"a52a8d17-9285-41e0-9d34-53aecb55afdc","Type":"ContainerStarted","Data":"2d6e15b72e093ae8eb4c50e4f2add00293ad72d8bb795d1e224a262f3d3b149a"} Jun 07 16:06:18.793291 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.793250 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-xmn48" Jun 07 16:06:18.797980 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.797914 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56966bf7f5-bl9lh" podStartSLOduration=1.453574765 podStartE2EDuration="11.797894551s" totalImagesPullingTime="10.344319786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:18.795998592 +0000 UTC m=+267.273448276" watchObservedRunningTime="2026-06-07 16:06:18.797894551 +0000 UTC m=+267.275344236" Jun 07 16:06:18.811350 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:18.811299 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-xmn48" podStartSLOduration=1.794206336 podStartE2EDuration="18.811282325s" totalImagesPullingTime="17.017075989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:18.81026272 +0000 UTC m=+267.287712404" watchObservedRunningTime="2026-06-07 16:06:18.811282325 +0000 UTC m=+267.288732008" Jun 07 16:06:19.791980 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.791926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" event={"ID":"a52a8d17-9285-41e0-9d34-53aecb55afdc","Type":"ContainerStarted","Data":"cc2dbebc6ad0280c324f1a94205ffa779227c4e41f25c1e3b2636f13e37edebc"} Jun 07 16:06:19.792446 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.792335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:19.798601 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.798573 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" Jun 07 16:06:19.810001 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.809919 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-28l7s" podStartSLOduration=9.699833164 podStartE2EDuration="10.809896427s" totalImagesPullingTime="1.110063263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:19.805977691 +0000 UTC m=+268.283427445" watchObservedRunningTime="2026-06-07 16:06:19.809896427 +0000 UTC m=+268.287346111" Jun 07 16:06:19.920220 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.920189 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ww86n"] Jun 07 16:06:19.946578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.946534 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ww86n"] Jun 07 16:06:19.946765 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.946636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:19.949372 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.949345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 07 16:06:19.949507 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.949424 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:06:19.949507 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.949347 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 07 16:06:19.949626 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:19.949610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5n8c7\"" Jun 07 16:06:20.017687 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.017642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.017916 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.017698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.017916 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.017739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8tx\" (UniqueName: \"kubernetes.io/projected/ed7b9069-7643-409d-a57d-affcc1cd2cc3-kube-api-access-vg8tx\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.017916 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.017782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7b9069-7643-409d-a57d-affcc1cd2cc3-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.119279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.119202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.119279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.119251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.119516 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.119290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8tx\" (UniqueName: \"kubernetes.io/projected/ed7b9069-7643-409d-a57d-affcc1cd2cc3-kube-api-access-vg8tx\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.119516 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.119320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7b9069-7643-409d-a57d-affcc1cd2cc3-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.120242 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.120211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7b9069-7643-409d-a57d-affcc1cd2cc3-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.122256 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.122227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.122915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.122890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed7b9069-7643-409d-a57d-affcc1cd2cc3-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.127450 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.127409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8tx\" (UniqueName: \"kubernetes.io/projected/ed7b9069-7643-409d-a57d-affcc1cd2cc3-kube-api-access-vg8tx\") pod \"prometheus-operator-7f7d445d84-ww86n\" (UID: \"ed7b9069-7643-409d-a57d-affcc1cd2cc3\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.258465 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.258431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" Jun 07 16:06:20.422725 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.422648 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-ww86n"] Jun 07 16:06:20.425195 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:20.425158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7b9069_7643_409d_a57d_affcc1cd2cc3.slice/crio-1942faed5348b8a2ea7115dbb9b5dcfbfc251d6c586bf37131c1e88e2d6c6498 WatchSource:0}: Error finding container 1942faed5348b8a2ea7115dbb9b5dcfbfc251d6c586bf37131c1e88e2d6c6498: Status 404 returned error can't find the container with id 1942faed5348b8a2ea7115dbb9b5dcfbfc251d6c586bf37131c1e88e2d6c6498 Jun 07 16:06:20.798377 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.798334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" event={"ID":"ed7b9069-7643-409d-a57d-affcc1cd2cc3","Type":"ContainerStarted","Data":"1942faed5348b8a2ea7115dbb9b5dcfbfc251d6c586bf37131c1e88e2d6c6498"} Jun 07 16:06:20.957706 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.957549 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:20.957706 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:20.957619 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:22.698016 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:22.697926 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:22.698545 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:22.698019 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:22.809208 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:22.809164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" event={"ID":"ed7b9069-7643-409d-a57d-affcc1cd2cc3","Type":"ContainerStarted","Data":"619e9a7cde3ea5f842ffe5f4248756d7500535263ee61e999004196055e33d4d"} Jun 07 16:06:22.809397 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:22.809237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" event={"ID":"ed7b9069-7643-409d-a57d-affcc1cd2cc3","Type":"ContainerStarted","Data":"c696743bdf53b293d171ca7c155c7ac4779e27094053222dcc39fd06f3cf0f76"} Jun 07 16:06:22.826208 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:22.826151 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-ww86n" podStartSLOduration=1.8148876779999998 podStartE2EDuration="3.826130719s" totalImagesPullingTime="2.011243041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:22.825168758 +0000 UTC m=+271.302618443" watchObservedRunningTime="2026-06-07 16:06:22.826130719 +0000 UTC m=+271.303580403" Jun 07 16:06:24.283208 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.283172 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8kb6z"] Jun 07 16:06:24.317300 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.317266 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.320471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.320156 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:06:24.320471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.320213 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7s4zr\"" Jun 07 16:06:24.320471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.320157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:06:24.320471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.320350 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:06:24.357318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-metrics-client-ca\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357528 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357528 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-root\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357528 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357528 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-wtmp\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357741 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-textfile\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357741 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-sys\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357741 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmn9\" (UniqueName: \"kubernetes.io/projected/b4d8a383-af82-4d6c-a49e-a99bb88f3256-kube-api-access-lnmn9\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.357741 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.357681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458543 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-wtmp\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-textfile\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-sys\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmn9\" (UniqueName: \"kubernetes.io/projected/b4d8a383-af82-4d6c-a49e-a99bb88f3256-kube-api-access-lnmn9\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-metrics-client-ca\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-wtmp\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-sys\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.458791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-root\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.459218 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:24.458809 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:06:24.459218 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:24.458880 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls podName:b4d8a383-af82-4d6c-a49e-a99bb88f3256 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:24.958860801 +0000 UTC m=+273.436310471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls") pod "node-exporter-8kb6z" (UID: "b4d8a383-af82-4d6c-a49e-a99bb88f3256") : secret "node-exporter-tls" not found Jun 07 16:06:24.459218 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458880 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4d8a383-af82-4d6c-a49e-a99bb88f3256-root\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.459218 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.458812 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.459218 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.459076 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-textfile\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.459458 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.459370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.459458 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.459403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4d8a383-af82-4d6c-a49e-a99bb88f3256-metrics-client-ca\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.461463 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.461437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.467352 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.467327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmn9\" (UniqueName: \"kubernetes.io/projected/b4d8a383-af82-4d6c-a49e-a99bb88f3256-kube-api-access-lnmn9\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.962892 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.962858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:24.965487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:24.965457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4d8a383-af82-4d6c-a49e-a99bb88f3256-node-exporter-tls\") pod \"node-exporter-8kb6z\" (UID: \"b4d8a383-af82-4d6c-a49e-a99bb88f3256\") " pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:25.228437 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.228358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kb6z" Jun 07 16:06:25.291380 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:25.291337 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d8a383_af82_4d6c_a49e_a99bb88f3256.slice/crio-c5ec39f01f07f102451dbb327dd60d6682a8d9f0da5f78d00f0272933b7df3d6 WatchSource:0}: Error finding container c5ec39f01f07f102451dbb327dd60d6682a8d9f0da5f78d00f0272933b7df3d6: Status 404 returned error can't find the container with id c5ec39f01f07f102451dbb327dd60d6682a8d9f0da5f78d00f0272933b7df3d6 Jun 07 16:06:25.317252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.317228 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:06:25.348096 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.348075 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.351623 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.351595 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 07 16:06:25.351819 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.351797 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrjml\"" Jun 07 16:06:25.352219 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.352198 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 07 16:06:25.352666 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.352637 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 07 16:06:25.353013 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.352975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 07 16:06:25.353420 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.353105 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 07 16:06:25.353539 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.353506 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 07 16:06:25.353611 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.353253 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 07 16:06:25.353667 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.353194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 07 16:06:25.358927 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.358905 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 07 16:06:25.369202 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.369184 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:06:25.468116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-out\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-web-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fnwk\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-kube-api-access-4fnwk\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.468604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.468541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569198 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569396 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569473 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569473 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fnwk\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-kube-api-access-4fnwk\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.569725 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.569584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.570000 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:25.569975 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 07 16:06:25.570275 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.570275 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:25.570233 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls podName:a2b34a3e-bf4b-4a49-a07d-45f778d79a37 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:26.070206507 +0000 UTC m=+274.547656177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a2b34a3e-bf4b-4a49-a07d-45f778d79a37") : secret "alertmanager-main-tls" not found Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570317 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-out\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.570514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-web-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572166 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.571673 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.572827 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.572803 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.573088 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.573066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.574482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.574455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.575218 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.575175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-out\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.575726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.575680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-web-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.576565 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.576219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.576565 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.576441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.576717 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.576610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.578917 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.578882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fnwk\" (UniqueName: \"kubernetes.io/projected/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-kube-api-access-4fnwk\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:25.828437 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:25.828304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kb6z" event={"ID":"b4d8a383-af82-4d6c-a49e-a99bb88f3256","Type":"ContainerStarted","Data":"c5ec39f01f07f102451dbb327dd60d6682a8d9f0da5f78d00f0272933b7df3d6"} Jun 07 16:06:26.077700 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:26.077234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:26.081544 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:26.081432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2b34a3e-bf4b-4a49-a07d-45f778d79a37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2b34a3e-bf4b-4a49-a07d-45f778d79a37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:26.260525 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:26.260486 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:06:26.542188 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:26.542093 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:06:26.545574 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:26.545542 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b34a3e_bf4b_4a49_a07d_45f778d79a37.slice/crio-47e13afc5b4db66a77db8c301bac8ef557443c1bd2e193e29144679640d8a06b WatchSource:0}: Error finding container 47e13afc5b4db66a77db8c301bac8ef557443c1bd2e193e29144679640d8a06b: Status 404 returned error can't find the container with id 47e13afc5b4db66a77db8c301bac8ef557443c1bd2e193e29144679640d8a06b Jun 07 16:06:26.834155 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:26.834114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"47e13afc5b4db66a77db8c301bac8ef557443c1bd2e193e29144679640d8a06b"} Jun 07 16:06:27.481795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.481698 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:27.481795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.481782 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:27.483214 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.483184 2561 patch_prober.go:28] interesting pod/console-56966bf7f5-bl9lh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 07 16:06:27.483344 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.483233 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56966bf7f5-bl9lh" podUID="2794713f-e10d-473e-99bc-262e88e7716a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 07 16:06:27.838905 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.838868 2561 generic.go:356] "Generic (PLEG): container finished" podID="b4d8a383-af82-4d6c-a49e-a99bb88f3256" containerID="203d273e740634f39c82ce03371c91cf1de266bf75ebb28eaf1c765368bfd5ef" exitCode=0 Jun 07 16:06:27.839253 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:27.838949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kb6z" event={"ID":"b4d8a383-af82-4d6c-a49e-a99bb88f3256","Type":"ContainerDied","Data":"203d273e740634f39c82ce03371c91cf1de266bf75ebb28eaf1c765368bfd5ef"} Jun 07 16:06:28.844976 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:28.844940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kb6z" event={"ID":"b4d8a383-af82-4d6c-a49e-a99bb88f3256","Type":"ContainerStarted","Data":"3d818a8916189d290b13b8363f592a9bfb962d0538e9d5ff27e1aa038ae1e7d0"} Jun 07 16:06:28.845390 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:28.844995 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kb6z" event={"ID":"b4d8a383-af82-4d6c-a49e-a99bb88f3256","Type":"ContainerStarted","Data":"992c702c124d42b549eb9b61df883a97a07409d2d6f8ca21196b6088d018a2af"} Jun 07 16:06:28.846467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:28.846439 2561 generic.go:356] "Generic (PLEG): container finished" podID="a2b34a3e-bf4b-4a49-a07d-45f778d79a37" containerID="c67d40de21a2ad2daf8810bc5c9747a1d6f2546c4635e2ae15dd77a309dc89b8" exitCode=0 Jun 07 16:06:28.846573 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:28.846521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerDied","Data":"c67d40de21a2ad2daf8810bc5c9747a1d6f2546c4635e2ae15dd77a309dc89b8"} Jun 07 16:06:28.865510 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:28.865467 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8kb6z" podStartSLOduration=3.2178528220000002 podStartE2EDuration="4.865452807s" totalImagesPullingTime="1.539662479s" totalInitContainerRuntime="107.937506ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:28.8638 +0000 UTC m=+277.341249683" watchObservedRunningTime="2026-06-07 16:06:28.865452807 +0000 UTC m=+277.342902489" Jun 07 16:06:29.387724 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:29.387696 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:30.956170 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:30.956142 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:30.956553 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:30.956183 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:31.864684 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:31.864646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"9c3aaf14d56a3ff79c779a470b68e4375250008f8167a728d90c94d1a27396df"} Jun 07 16:06:31.864935 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:31.864783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"511f673a204bfb0b804b7a0bc12b0f58966f0bfd11f8104ebd1b4e034e9714b6"} Jun 07 16:06:31.864935 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:31.864830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"c8b7cb0a90d7e0bbcec8718a8dabec10a92f26f4be983ba0c558f2178b237bfb"} Jun 07 16:06:31.864935 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:31.864872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"84afe733adc2da99f22611f1f5e06ce078b0fc398dda0dd65caf53456c2f82ee"} Jun 07 16:06:31.864935 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:31.864923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"c1bd2913dbbccbf62cd0ba4b79f7e49fb8006ee5d7dbb99b25a93c82cd79cdd1"} Jun 07 16:06:32.440918 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:32.440875 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7s9s" podUID="b8e350eb-133a-4a0b-88e9-d044d171136e" Jun 07 16:06:32.695862 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:32.695792 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:32.695862 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:32.695838 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:32.872131 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:32.872094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2b34a3e-bf4b-4a49-a07d-45f778d79a37","Type":"ContainerStarted","Data":"ad4b3fd9981fe03ad11a9e346b53fe4c5e2dd8ba3cf5e6a79432a004a856733a"} Jun 07 16:06:32.872131 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:32.872115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:32.898589 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:32.898442 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.391170644 podStartE2EDuration="7.898422232s" totalImagesPullingTime="4.491008177s" totalInitContainerRuntime="16.243411ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:32.896439012 +0000 UTC m=+281.373888717" watchObservedRunningTime="2026-06-07 16:06:32.898422232 +0000 UTC m=+281.375871916" Jun 07 16:06:34.015358 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.015325 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:06:34.029419 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.029384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.031406 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.031376 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:06:34.036559 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.036535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 16:06:34.152422 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152779 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfbn\" (UniqueName: \"kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.152779 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.152619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254047 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfbn\" (UniqueName: \"kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.254328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.255003 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.254977 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.255123 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.255060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.255123 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.255081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.256613 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.256593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.256690 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.256621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.268192 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.268143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfbn\" (UniqueName: \"kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.280912 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.280893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert\") pod \"console-79cf4c9f86-bmmnw\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.341390 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.341367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:34.507283 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.507121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:06:34.510205 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:34.510176 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5748930_60ee_4935_98d5_b8a55e917293.slice/crio-6d44cd1064727520669d51af94cddd563d2b89d8dafcdb9d2003690552f16acb WatchSource:0}: Error finding container 6d44cd1064727520669d51af94cddd563d2b89d8dafcdb9d2003690552f16acb: Status 404 returned error can't find the container with id 6d44cd1064727520669d51af94cddd563d2b89d8dafcdb9d2003690552f16acb Jun 07 16:06:34.882279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.882190 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf4c9f86-bmmnw" event={"ID":"f5748930-60ee-4935-98d5-b8a55e917293","Type":"ContainerStarted","Data":"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a"} Jun 07 16:06:34.882279 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.882239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf4c9f86-bmmnw" event={"ID":"f5748930-60ee-4935-98d5-b8a55e917293","Type":"ContainerStarted","Data":"6d44cd1064727520669d51af94cddd563d2b89d8dafcdb9d2003690552f16acb"} Jun 07 16:06:34.900649 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:34.900602 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cf4c9f86-bmmnw" podStartSLOduration=1.900586388 podStartE2EDuration="1.900586388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:34.898195339 +0000 UTC m=+283.375645023" watchObservedRunningTime="2026-06-07 16:06:34.900586388 +0000 UTC m=+283.378036070" Jun 07 16:06:36.372340 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.372295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:36.374576 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.374553 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8e350eb-133a-4a0b-88e9-d044d171136e-metrics-tls\") pod \"dns-default-x7s9s\" (UID: \"b8e350eb-133a-4a0b-88e9-d044d171136e\") " pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:36.475241 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.475208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:06:36.483124 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.483100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:36.628040 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.628012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7s9s"] Jun 07 16:06:36.630218 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:06:36.630191 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e350eb_133a_4a0b_88e9_d044d171136e.slice/crio-24926787ee9ed2c31bad25418c09200ae947fd359817884e732d09eae75e2599 WatchSource:0}: Error finding container 24926787ee9ed2c31bad25418c09200ae947fd359817884e732d09eae75e2599: Status 404 returned error can't find the container with id 24926787ee9ed2c31bad25418c09200ae947fd359817884e732d09eae75e2599 Jun 07 16:06:36.891221 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:36.891138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7s9s" event={"ID":"b8e350eb-133a-4a0b-88e9-d044d171136e","Type":"ContainerStarted","Data":"24926787ee9ed2c31bad25418c09200ae947fd359817884e732d09eae75e2599"} Jun 07 16:06:38.901160 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:38.901087 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7s9s" event={"ID":"b8e350eb-133a-4a0b-88e9-d044d171136e","Type":"ContainerStarted","Data":"8b1b0df1b1c801617597d0a0e260b91bc1e626554e69c1a9f409698d0668aa7a"} Jun 07 16:06:38.901160 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:38.901136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7s9s" event={"ID":"b8e350eb-133a-4a0b-88e9-d044d171136e","Type":"ContainerStarted","Data":"30f22f50605e513746730e5bf9f1fc8260126fb330d59fb1b86f43daa592df51"} Jun 07 16:06:38.901576 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:38.901205 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:38.916068 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:38.916021 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x7s9s" podStartSLOduration=251.047332868 podStartE2EDuration="4m12.916007852s" totalImagesPullingTime="1.868674984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:38.915879305 +0000 UTC m=+287.393329001" watchObservedRunningTime="2026-06-07 16:06:38.916007852 +0000 UTC m=+287.393457600" Jun 07 16:06:40.957346 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.957312 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:40.957855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.957382 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:40.957855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.957422 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:06:40.957963 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.957864 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"dfc309581f3c03d6687b6910795568708690987db177790e70ec46225613d143"} pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" containerMessage="Container registry failed liveness probe, will be restarted" Jun 07 16:06:40.961380 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.961352 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:40.961499 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:40.961403 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:44.342076 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:44.341986 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:44.342076 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:44.342045 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:44.343326 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:44.343302 2561 patch_prober.go:28] interesting pod/console-79cf4c9f86-bmmnw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 07 16:06:44.343436 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:44.343351 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-79cf4c9f86-bmmnw" podUID="f5748930-60ee-4935-98d5-b8a55e917293" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 07 16:06:48.908079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:48.907990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x7s9s" Jun 07 16:06:48.939578 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:48.939546 2561 generic.go:356] "Generic (PLEG): container finished" podID="11a9ee97-bde3-418a-8b63-a19aacd8c4ec" containerID="cb6d238562f8fe35a52e013a5e5c0a1eda82466accab668b418394f7d9ce4ed8" exitCode=0 Jun 07 16:06:48.939742 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:48.939610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-9b4rp" event={"ID":"11a9ee97-bde3-418a-8b63-a19aacd8c4ec","Type":"ContainerDied","Data":"cb6d238562f8fe35a52e013a5e5c0a1eda82466accab668b418394f7d9ce4ed8"} Jun 07 16:06:48.939990 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:48.939975 2561 scope.go:117] "RemoveContainer" containerID="cb6d238562f8fe35a52e013a5e5c0a1eda82466accab668b418394f7d9ce4ed8" Jun 07 16:06:49.949842 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:49.949805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-9b4rp" event={"ID":"11a9ee97-bde3-418a-8b63-a19aacd8c4ec","Type":"ContainerStarted","Data":"20e671861419a33eedb520352ffc4d878bc6bcb1e1b5f758ea3d4937de6d5f97"} Jun 07 16:06:50.961838 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:50.961805 2561 patch_prober.go:28] interesting pod/image-registry-bdc5b94d6-fgmtl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:50.962228 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:50.961855 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:51.926838 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:51.926805 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:06:51.927702 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:51.927681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:06:51.932663 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:51.932644 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:06:54.346297 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.346267 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:54.367697 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.351169 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:06:54.408499 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.408426 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56966bf7f5-bl9lh" podUID="2794713f-e10d-473e-99bc-262e88e7716a" containerName="console" containerID="cri-o://dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78" gracePeriod=15 Jun 07 16:06:54.698929 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.698897 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:54.733134 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733104 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733148 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h24lr\" (UniqueName: \"kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733194 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733248 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733486 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733377 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733486 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733417 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config\") pod \"2794713f-e10d-473e-99bc-262e88e7716a\" (UID: \"2794713f-e10d-473e-99bc-262e88e7716a\") " Jun 07 16:06:54.733934 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.733903 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:54.734079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.734028 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:54.734079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.734057 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config" (OuterVolumeSpecName: "console-config") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:54.735534 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.735511 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr" (OuterVolumeSpecName: "kube-api-access-h24lr") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "kube-api-access-h24lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:06:54.735767 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.735736 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:54.736027 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.736004 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2794713f-e10d-473e-99bc-262e88e7716a" (UID: "2794713f-e10d-473e-99bc-262e88e7716a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:54.834207 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834169 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-oauth-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.834207 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834202 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-console-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.834207 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834212 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2794713f-e10d-473e-99bc-262e88e7716a-service-ca\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.834207 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834220 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h24lr\" (UniqueName: \"kubernetes.io/projected/2794713f-e10d-473e-99bc-262e88e7716a-kube-api-access-h24lr\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.834471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834229 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-oauth-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.834471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.834238 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2794713f-e10d-473e-99bc-262e88e7716a-console-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:06:54.969336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.969242 2561 generic.go:356] "Generic (PLEG): container finished" podID="2794713f-e10d-473e-99bc-262e88e7716a" containerID="dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78" exitCode=0 Jun 07 16:06:54.969336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.969286 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56966bf7f5-bl9lh" Jun 07 16:06:54.969336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.969328 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56966bf7f5-bl9lh" event={"ID":"2794713f-e10d-473e-99bc-262e88e7716a","Type":"ContainerDied","Data":"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78"} Jun 07 16:06:54.969607 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.969373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56966bf7f5-bl9lh" event={"ID":"2794713f-e10d-473e-99bc-262e88e7716a","Type":"ContainerDied","Data":"84e55959ed490598dbcd9d5e11b76f1d32b20c8cfb2a177a66851aa772bea48a"} Jun 07 16:06:54.969607 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.969407 2561 scope.go:117] "RemoveContainer" containerID="dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78" Jun 07 16:06:54.978553 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.978532 2561 scope.go:117] "RemoveContainer" containerID="dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78" Jun 07 16:06:54.978872 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:06:54.978851 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78\": container with ID starting with dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78 not found: ID does not exist" containerID="dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78" Jun 07 16:06:54.978945 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.978887 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78"} err="failed to get container status \"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78\": rpc error: code = NotFound desc = could not find container \"dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78\": container with ID starting with dc15d68640787a0428e31880b246b714c044c398b385d3bc768801e2f778ec78 not found: ID does not exist" Jun 07 16:06:54.988930 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.988901 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:54.994803 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:54.994777 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56966bf7f5-bl9lh"] Jun 07 16:06:55.967827 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:06:55.967793 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2794713f-e10d-473e-99bc-262e88e7716a" path="/var/lib/kubelet/pods/2794713f-e10d-473e-99bc-262e88e7716a/volumes" Jun 07 16:07:00.961793 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:00.961740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:07:04.008139 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:04.008101 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2873b35-d559-41a9-9e1e-037cf45e35aa" containerID="79a0791885ca5298884754a8ecb4243127982d0be3e158493f121d75e6750f1a" exitCode=0 Jun 07 16:07:04.008524 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:04.008174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" event={"ID":"f2873b35-d559-41a9-9e1e-037cf45e35aa","Type":"ContainerDied","Data":"79a0791885ca5298884754a8ecb4243127982d0be3e158493f121d75e6750f1a"} Jun 07 16:07:04.008524 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:04.008479 2561 scope.go:117] "RemoveContainer" containerID="79a0791885ca5298884754a8ecb4243127982d0be3e158493f121d75e6750f1a" Jun 07 16:07:05.014671 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:05.014637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5dq45" event={"ID":"f2873b35-d559-41a9-9e1e-037cf45e35aa","Type":"ContainerStarted","Data":"807a473de8fd1a2304f46faeae1217d76023bc3a93c448cea38559db7ab3f5be"} Jun 07 16:07:05.977545 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:05.977501 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" podUID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerName="registry" containerID="cri-o://dfc309581f3c03d6687b6910795568708690987db177790e70ec46225613d143" gracePeriod=30 Jun 07 16:07:08.028333 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:08.028299 2561 generic.go:356] "Generic (PLEG): container finished" podID="83ddd003-b1b5-457e-aef4-c79539873f6a" containerID="dfc309581f3c03d6687b6910795568708690987db177790e70ec46225613d143" exitCode=0 Jun 07 16:07:08.028726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:08.028344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" event={"ID":"83ddd003-b1b5-457e-aef4-c79539873f6a","Type":"ContainerDied","Data":"dfc309581f3c03d6687b6910795568708690987db177790e70ec46225613d143"} Jun 07 16:07:08.028726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:08.028374 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" event={"ID":"83ddd003-b1b5-457e-aef4-c79539873f6a","Type":"ContainerStarted","Data":"244398d1955ade32da6d2d4415bd6886f2363d0e88ea247e39a3aa0810050963"} Jun 07 16:07:08.028726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:08.028447 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:07:14.051906 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:14.051869 2561 generic.go:356] "Generic (PLEG): container finished" podID="b8c93f94-63c5-4d8a-9b70-48358a2781ad" containerID="96561b699ddd8272877b3c96864553f3040e06fa64fa58f5bee2350fbfd1aa01" exitCode=0 Jun 07 16:07:14.052298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:14.051945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" event={"ID":"b8c93f94-63c5-4d8a-9b70-48358a2781ad","Type":"ContainerDied","Data":"96561b699ddd8272877b3c96864553f3040e06fa64fa58f5bee2350fbfd1aa01"} Jun 07 16:07:14.052298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:14.052246 2561 scope.go:117] "RemoveContainer" containerID="96561b699ddd8272877b3c96864553f3040e06fa64fa58f5bee2350fbfd1aa01" Jun 07 16:07:15.057895 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:15.057859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jxhv2" event={"ID":"b8c93f94-63c5-4d8a-9b70-48358a2781ad","Type":"ContainerStarted","Data":"435dbd2adf398e42e1af663180d4350e05cc7608b0e923c28663a53a73361f9d"} Jun 07 16:07:29.038111 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:29.038083 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdc5b94d6-fgmtl" Jun 07 16:07:58.863721 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.863687 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:07:58.864144 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.864004 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2794713f-e10d-473e-99bc-262e88e7716a" containerName="console" Jun 07 16:07:58.864144 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.864015 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2794713f-e10d-473e-99bc-262e88e7716a" containerName="console" Jun 07 16:07:58.864144 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.864078 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2794713f-e10d-473e-99bc-262e88e7716a" containerName="console" Jun 07 16:07:58.866791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.866768 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.877076 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.877046 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:07:58.975535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drvb\" (UniqueName: \"kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:58.975789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:58.975648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076682 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.076872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drvb\" (UniqueName: \"kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.077122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.076887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.077497 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.077468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.077655 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.077635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.077726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.077687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.077811 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.077715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.079268 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.079238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.079451 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.079434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.084265 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.084243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drvb\" (UniqueName: \"kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb\") pod \"console-59bcd88d87-4vj8p\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.178138 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.178052 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:07:59.305922 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:07:59.305900 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:07:59.308365 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:07:59.308338 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0d542d_a71c_4c8f_bdf9_7385cc8a77f0.slice/crio-cb7cc6f02f714e8f68e6a5e0f25a18ff650d45a4817f9a88b4bf6dfb80187700 WatchSource:0}: Error finding container cb7cc6f02f714e8f68e6a5e0f25a18ff650d45a4817f9a88b4bf6dfb80187700: Status 404 returned error can't find the container with id cb7cc6f02f714e8f68e6a5e0f25a18ff650d45a4817f9a88b4bf6dfb80187700 Jun 07 16:08:00.231552 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:00.231520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bcd88d87-4vj8p" event={"ID":"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0","Type":"ContainerStarted","Data":"5191a0b546401113646fec708b85a1ee8f4445e0daa4a45c0d135da12ba55c25"} Jun 07 16:08:00.231976 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:00.231574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bcd88d87-4vj8p" event={"ID":"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0","Type":"ContainerStarted","Data":"cb7cc6f02f714e8f68e6a5e0f25a18ff650d45a4817f9a88b4bf6dfb80187700"} Jun 07 16:08:00.249515 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:00.249468 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59bcd88d87-4vj8p" podStartSLOduration=2.2494515 podStartE2EDuration="2.2494515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:08:00.248914716 +0000 UTC m=+368.726364400" watchObservedRunningTime="2026-06-07 16:08:00.2494515 +0000 UTC m=+368.726901183" Jun 07 16:08:09.179122 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:09.179084 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:08:09.179495 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:09.179166 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:08:09.184018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:09.183995 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:08:09.272097 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:09.272076 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:08:09.324627 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:09.324599 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:08:34.349366 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.349301 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79cf4c9f86-bmmnw" podUID="f5748930-60ee-4935-98d5-b8a55e917293" containerName="console" containerID="cri-o://07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a" gracePeriod=15 Jun 07 16:08:34.610514 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.610451 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:08:34.692567 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692535 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692567 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692570 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692596 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692622 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkfbn\" (UniqueName: \"kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692640 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692692 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.692844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.692708 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config\") pod \"f5748930-60ee-4935-98d5-b8a55e917293\" (UID: \"f5748930-60ee-4935-98d5-b8a55e917293\") " Jun 07 16:08:34.693103 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.693070 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config" (OuterVolumeSpecName: "console-config") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:08:34.693189 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.693162 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca" (OuterVolumeSpecName: "service-ca") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:08:34.693311 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.693189 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:08:34.693375 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.693354 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:08:34.694849 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.694820 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:08:34.694849 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.694836 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:08:34.695010 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.694894 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn" (OuterVolumeSpecName: "kube-api-access-tkfbn") pod "f5748930-60ee-4935-98d5-b8a55e917293" (UID: "f5748930-60ee-4935-98d5-b8a55e917293"). InnerVolumeSpecName "kube-api-access-tkfbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:08:34.794181 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794139 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794181 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794170 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-console-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794181 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794180 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-oauth-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794181 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794188 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkfbn\" (UniqueName: \"kubernetes.io/projected/f5748930-60ee-4935-98d5-b8a55e917293-kube-api-access-tkfbn\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794444 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794198 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-trusted-ca-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794444 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794206 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5748930-60ee-4935-98d5-b8a55e917293-service-ca\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:34.794444 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:34.794214 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5748930-60ee-4935-98d5-b8a55e917293-console-oauth-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:08:35.372303 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.372269 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5748930-60ee-4935-98d5-b8a55e917293" containerID="07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a" exitCode=0 Jun 07 16:08:35.372724 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.372314 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf4c9f86-bmmnw" Jun 07 16:08:35.372724 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.372348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf4c9f86-bmmnw" event={"ID":"f5748930-60ee-4935-98d5-b8a55e917293","Type":"ContainerDied","Data":"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a"} Jun 07 16:08:35.372724 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.372392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf4c9f86-bmmnw" event={"ID":"f5748930-60ee-4935-98d5-b8a55e917293","Type":"ContainerDied","Data":"6d44cd1064727520669d51af94cddd563d2b89d8dafcdb9d2003690552f16acb"} Jun 07 16:08:35.372724 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.372412 2561 scope.go:117] "RemoveContainer" containerID="07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a" Jun 07 16:08:35.381109 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.381091 2561 scope.go:117] "RemoveContainer" containerID="07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a" Jun 07 16:08:35.381358 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:08:35.381340 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a\": container with ID starting with 07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a not found: ID does not exist" containerID="07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a" Jun 07 16:08:35.381417 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.381364 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a"} err="failed to get container status \"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a\": rpc error: code = NotFound desc = could not find container \"07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a\": container with ID starting with 07b142340c976e48c3082c8b6f7ff2f19eb7445ab374af1929bcd6d92276358a not found: ID does not exist" Jun 07 16:08:35.392356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.392337 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:08:35.396535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.396511 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cf4c9f86-bmmnw"] Jun 07 16:08:35.968336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:35.968295 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5748930-60ee-4935-98d5-b8a55e917293" path="/var/lib/kubelet/pods/f5748930-60ee-4935-98d5-b8a55e917293/volumes" Jun 07 16:08:58.583308 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.583269 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m"] Jun 07 16:08:58.583698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.583556 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5748930-60ee-4935-98d5-b8a55e917293" containerName="console" Jun 07 16:08:58.583698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.583566 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5748930-60ee-4935-98d5-b8a55e917293" containerName="console" Jun 07 16:08:58.583698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.583631 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5748930-60ee-4935-98d5-b8a55e917293" containerName="console" Jun 07 16:08:58.586433 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.586415 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.588860 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.588829 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:08:58.589591 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.589567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:08:58.589591 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.589581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:08:58.595017 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.594991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m"] Jun 07 16:08:58.688314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.688273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzdk\" (UniqueName: \"kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.688314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.688313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.688529 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.688363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.788857 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.788827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.788996 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.788892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzdk\" (UniqueName: \"kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.788996 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.788912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.789248 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.789232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.789281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.789227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.796855 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.796829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzdk\" (UniqueName: \"kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:58.896660 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:58.896595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:08:59.017729 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:59.017679 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m"] Jun 07 16:08:59.020504 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:08:59.020479 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cd64ee_701d_425e_9798_94eee01be6d0.slice/crio-35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975 WatchSource:0}: Error finding container 35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975: Status 404 returned error can't find the container with id 35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975 Jun 07 16:08:59.022878 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:59.022862 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:08:59.473848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:08:59.473808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" event={"ID":"55cd64ee-701d-425e-9798-94eee01be6d0","Type":"ContainerStarted","Data":"35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975"} Jun 07 16:09:06.504805 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:06.504774 2561 generic.go:356] "Generic (PLEG): container finished" podID="55cd64ee-701d-425e-9798-94eee01be6d0" containerID="a320899506faaf891293a4fae971b20512b716f156ca0595104bad71a8232b6c" exitCode=0 Jun 07 16:09:06.505222 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:06.504853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" event={"ID":"55cd64ee-701d-425e-9798-94eee01be6d0","Type":"ContainerDied","Data":"a320899506faaf891293a4fae971b20512b716f156ca0595104bad71a8232b6c"} Jun 07 16:09:09.519482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:09.519449 2561 generic.go:356] "Generic (PLEG): container finished" podID="55cd64ee-701d-425e-9798-94eee01be6d0" containerID="d17cd86324fa9b0fe88802bd0a0af1321cf75a24361cff4bd5dfb606227110b1" exitCode=0 Jun 07 16:09:09.519886 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:09.519524 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" event={"ID":"55cd64ee-701d-425e-9798-94eee01be6d0","Type":"ContainerDied","Data":"d17cd86324fa9b0fe88802bd0a0af1321cf75a24361cff4bd5dfb606227110b1"} Jun 07 16:09:17.555891 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:17.555853 2561 generic.go:356] "Generic (PLEG): container finished" podID="55cd64ee-701d-425e-9798-94eee01be6d0" containerID="e4c3928ea7fd080e3f0662c4c6e8738002d1b736d1bfe39a52e93cfc5464739b" exitCode=0 Jun 07 16:09:17.556253 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:17.555901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" event={"ID":"55cd64ee-701d-425e-9798-94eee01be6d0","Type":"ContainerDied","Data":"e4c3928ea7fd080e3f0662c4c6e8738002d1b736d1bfe39a52e93cfc5464739b"} Jun 07 16:09:18.693885 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.693859 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:09:18.762326 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.762294 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle\") pod \"55cd64ee-701d-425e-9798-94eee01be6d0\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " Jun 07 16:09:18.762491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.762383 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util\") pod \"55cd64ee-701d-425e-9798-94eee01be6d0\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " Jun 07 16:09:18.762491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.762413 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krzdk\" (UniqueName: \"kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk\") pod \"55cd64ee-701d-425e-9798-94eee01be6d0\" (UID: \"55cd64ee-701d-425e-9798-94eee01be6d0\") " Jun 07 16:09:18.763143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.763114 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle" (OuterVolumeSpecName: "bundle") pod "55cd64ee-701d-425e-9798-94eee01be6d0" (UID: "55cd64ee-701d-425e-9798-94eee01be6d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:18.764600 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.764578 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk" (OuterVolumeSpecName: "kube-api-access-krzdk") pod "55cd64ee-701d-425e-9798-94eee01be6d0" (UID: "55cd64ee-701d-425e-9798-94eee01be6d0"). InnerVolumeSpecName "kube-api-access-krzdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:09:18.766726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.766706 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util" (OuterVolumeSpecName: "util") pod "55cd64ee-701d-425e-9798-94eee01be6d0" (UID: "55cd64ee-701d-425e-9798-94eee01be6d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:18.863485 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.863405 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:18.863485 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.863430 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krzdk\" (UniqueName: \"kubernetes.io/projected/55cd64ee-701d-425e-9798-94eee01be6d0-kube-api-access-krzdk\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:18.863485 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:18.863443 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55cd64ee-701d-425e-9798-94eee01be6d0-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:19.565870 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:19.565838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" event={"ID":"55cd64ee-701d-425e-9798-94eee01be6d0","Type":"ContainerDied","Data":"35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975"} Jun 07 16:09:19.566036 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:19.565876 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkzv6m" Jun 07 16:09:19.566036 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:19.565887 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35af13b2d723f90b481a891989bcf958122b656a8ab6c70b196361f7781f8975" Jun 07 16:09:26.720301 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720261 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p"] Jun 07 16:09:26.720792 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720730 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="pull" Jun 07 16:09:26.720792 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720748 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="pull" Jun 07 16:09:26.720933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720802 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="util" Jun 07 16:09:26.720933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720811 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="util" Jun 07 16:09:26.720933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720824 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="extract" Jun 07 16:09:26.720933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720832 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="extract" Jun 07 16:09:26.720933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.720932 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="55cd64ee-701d-425e-9798-94eee01be6d0" containerName="extract" Jun 07 16:09:26.725216 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.725193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.727720 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.727693 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:09:26.727874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.727733 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 07 16:09:26.727874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.727744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4t9nf\"" Jun 07 16:09:26.737957 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.737922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p"] Jun 07 16:09:26.833609 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.833569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66dec8d4-10b5-4272-8af1-ef5c43b587ea-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.833791 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.833646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4w5\" (UniqueName: \"kubernetes.io/projected/66dec8d4-10b5-4272-8af1-ef5c43b587ea-kube-api-access-sg4w5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.934160 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.934112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4w5\" (UniqueName: \"kubernetes.io/projected/66dec8d4-10b5-4272-8af1-ef5c43b587ea-kube-api-access-sg4w5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.934254 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.934176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66dec8d4-10b5-4272-8af1-ef5c43b587ea-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.934515 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.934500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66dec8d4-10b5-4272-8af1-ef5c43b587ea-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:26.942772 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:26.942725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4w5\" (UniqueName: \"kubernetes.io/projected/66dec8d4-10b5-4272-8af1-ef5c43b587ea-kube-api-access-sg4w5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9gx8p\" (UID: \"66dec8d4-10b5-4272-8af1-ef5c43b587ea\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:27.035626 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:27.035597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" Jun 07 16:09:27.171214 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:27.171188 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p"] Jun 07 16:09:27.174011 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:09:27.173982 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66dec8d4_10b5_4272_8af1_ef5c43b587ea.slice/crio-9903804dd21f6dca4802df5ca058089768150835d664458a834b714e691f975f WatchSource:0}: Error finding container 9903804dd21f6dca4802df5ca058089768150835d664458a834b714e691f975f: Status 404 returned error can't find the container with id 9903804dd21f6dca4802df5ca058089768150835d664458a834b714e691f975f Jun 07 16:09:27.600514 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:27.600479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" event={"ID":"66dec8d4-10b5-4272-8af1-ef5c43b587ea","Type":"ContainerStarted","Data":"9903804dd21f6dca4802df5ca058089768150835d664458a834b714e691f975f"} Jun 07 16:09:30.615356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:30.615320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" event={"ID":"66dec8d4-10b5-4272-8af1-ef5c43b587ea","Type":"ContainerStarted","Data":"8d34ff3dd58e3095406172e8f86f899b026ee585109b7d4795163493f2a7001c"} Jun 07 16:09:30.634394 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:30.634341 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9gx8p" podStartSLOduration=2.141300378 podStartE2EDuration="4.634325433s" totalImagesPullingTime="2.493025055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:09:30.632362072 +0000 UTC m=+459.109811754" watchObservedRunningTime="2026-06-07 16:09:30.634325433 +0000 UTC m=+459.111775116" Jun 07 16:09:31.183471 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.183437 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2"] Jun 07 16:09:31.185706 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.185686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.189110 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.189087 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:09:31.189227 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.189129 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:09:31.189227 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.189136 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:09:31.196356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.196333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2"] Jun 07 16:09:31.273949 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.273914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.274143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.273977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dkj9\" (UniqueName: \"kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.274143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.274061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.374544 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.374512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.374682 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.374559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dkj9\" (UniqueName: \"kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.374774 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.374672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.374942 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.374923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.375045 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.375026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.382134 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.382113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dkj9\" (UniqueName: \"kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.495262 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.495228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:31.628721 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:31.628701 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2"] Jun 07 16:09:31.631055 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:09:31.631032 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0141296a_9e3d_46e8_bade_3e53a98f85cc.slice/crio-084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf WatchSource:0}: Error finding container 084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf: Status 404 returned error can't find the container with id 084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf Jun 07 16:09:32.625726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:32.625690 2561 generic.go:356] "Generic (PLEG): container finished" podID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerID="a652d47e2604acdf2faa50efe20f6d952c18b142cac3b81371e83fef30e10c74" exitCode=0 Jun 07 16:09:32.625912 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:32.625736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" event={"ID":"0141296a-9e3d-46e8-bade-3e53a98f85cc","Type":"ContainerDied","Data":"a652d47e2604acdf2faa50efe20f6d952c18b142cac3b81371e83fef30e10c74"} Jun 07 16:09:32.625912 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:32.625798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" event={"ID":"0141296a-9e3d-46e8-bade-3e53a98f85cc","Type":"ContainerStarted","Data":"084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf"} Jun 07 16:09:35.643163 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.643126 2561 generic.go:356] "Generic (PLEG): container finished" podID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerID="f58a8dd8472009525a54c1c746f099e0ee8fe428840a736f7369923ab13a6bda" exitCode=0 Jun 07 16:09:35.643548 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.643198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" event={"ID":"0141296a-9e3d-46e8-bade-3e53a98f85cc","Type":"ContainerDied","Data":"f58a8dd8472009525a54c1c746f099e0ee8fe428840a736f7369923ab13a6bda"} Jun 07 16:09:35.658971 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.658945 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h27dd"] Jun 07 16:09:35.661717 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.661698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.665160 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.665134 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gtg4j\"" Jun 07 16:09:35.665299 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.665179 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 16:09:35.665299 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.665179 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 16:09:35.668978 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.668953 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h27dd"] Jun 07 16:09:35.713732 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.713697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.713944 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.713877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p2ff\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-kube-api-access-9p2ff\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.815200 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.815165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p2ff\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-kube-api-access-9p2ff\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.815348 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.815232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.823679 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.823650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:35.823833 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:35.823815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p2ff\" (UniqueName: \"kubernetes.io/projected/8357b423-7aea-4c4a-8747-8aade8fca3e9-kube-api-access-9p2ff\") pod \"cert-manager-cainjector-5d99449ffd-h27dd\" (UID: \"8357b423-7aea-4c4a-8747-8aade8fca3e9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:36.007338 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:36.007305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" Jun 07 16:09:36.142152 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:36.142110 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h27dd"] Jun 07 16:09:36.145189 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:09:36.145160 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8357b423_7aea_4c4a_8747_8aade8fca3e9.slice/crio-924029159d1c8e7665d97e2b62c93db7a00d70a5733bf4a4202b934ac41f74db WatchSource:0}: Error finding container 924029159d1c8e7665d97e2b62c93db7a00d70a5733bf4a4202b934ac41f74db: Status 404 returned error can't find the container with id 924029159d1c8e7665d97e2b62c93db7a00d70a5733bf4a4202b934ac41f74db Jun 07 16:09:36.652105 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:36.652067 2561 generic.go:356] "Generic (PLEG): container finished" podID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerID="12df5737a09444c40bf7a4a2e3da1a6ffd7852dedf318bb2619e583f346c6fe3" exitCode=0 Jun 07 16:09:36.652584 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:36.652230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" event={"ID":"0141296a-9e3d-46e8-bade-3e53a98f85cc","Type":"ContainerDied","Data":"12df5737a09444c40bf7a4a2e3da1a6ffd7852dedf318bb2619e583f346c6fe3"} Jun 07 16:09:36.653815 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:36.653778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" event={"ID":"8357b423-7aea-4c4a-8747-8aade8fca3e9","Type":"ContainerStarted","Data":"924029159d1c8e7665d97e2b62c93db7a00d70a5733bf4a4202b934ac41f74db"} Jun 07 16:09:38.332517 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.332487 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:38.439446 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.439428 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dkj9\" (UniqueName: \"kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9\") pod \"0141296a-9e3d-46e8-bade-3e53a98f85cc\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " Jun 07 16:09:38.439564 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.439475 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util\") pod \"0141296a-9e3d-46e8-bade-3e53a98f85cc\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " Jun 07 16:09:38.439564 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.439518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle\") pod \"0141296a-9e3d-46e8-bade-3e53a98f85cc\" (UID: \"0141296a-9e3d-46e8-bade-3e53a98f85cc\") " Jun 07 16:09:38.439970 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.439945 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle" (OuterVolumeSpecName: "bundle") pod "0141296a-9e3d-46e8-bade-3e53a98f85cc" (UID: "0141296a-9e3d-46e8-bade-3e53a98f85cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:38.441436 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.441410 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9" (OuterVolumeSpecName: "kube-api-access-8dkj9") pod "0141296a-9e3d-46e8-bade-3e53a98f85cc" (UID: "0141296a-9e3d-46e8-bade-3e53a98f85cc"). InnerVolumeSpecName "kube-api-access-8dkj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:09:38.444639 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.444616 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util" (OuterVolumeSpecName: "util") pod "0141296a-9e3d-46e8-bade-3e53a98f85cc" (UID: "0141296a-9e3d-46e8-bade-3e53a98f85cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:38.541018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.540978 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:38.541018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.541010 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dkj9\" (UniqueName: \"kubernetes.io/projected/0141296a-9e3d-46e8-bade-3e53a98f85cc-kube-api-access-8dkj9\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:38.541018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.541019 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0141296a-9e3d-46e8-bade-3e53a98f85cc-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:38.665994 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.665899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" event={"ID":"8357b423-7aea-4c4a-8747-8aade8fca3e9","Type":"ContainerStarted","Data":"369eac89a833a0736cb610867fb72793394f9dc719812a6e7496f03ec155dddb"} Jun 07 16:09:38.667832 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.667811 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" Jun 07 16:09:38.667983 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.667807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jpt2" event={"ID":"0141296a-9e3d-46e8-bade-3e53a98f85cc","Type":"ContainerDied","Data":"084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf"} Jun 07 16:09:38.667983 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.667926 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084c647e10fe4b28f6b296d90e5a0d50b97b58ae1af02d59a7540aa515f19fbf" Jun 07 16:09:38.680644 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:38.680603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h27dd" podStartSLOduration=1.453056908 podStartE2EDuration="3.680584739s" totalImagesPullingTime="2.227527831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:09:38.67950074 +0000 UTC m=+467.156950436" watchObservedRunningTime="2026-06-07 16:09:38.680584739 +0000 UTC m=+467.158034422" Jun 07 16:09:53.835408 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835372 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6"] Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835715 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="pull" Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835728 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="pull" Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835742 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="util" Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835747 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="util" Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835777 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="extract" Jun 07 16:09:53.835799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835782 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="extract" Jun 07 16:09:53.835986 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.835852 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0141296a-9e3d-46e8-bade-3e53a98f85cc" containerName="extract" Jun 07 16:09:53.838508 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.838489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:53.840915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.840894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:09:53.841025 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.840956 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:09:53.841083 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.841072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:09:53.847420 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.847394 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6"] Jun 07 16:09:53.975820 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.975772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:53.976010 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.975894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:53.976010 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:53.975918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m697v\" (UniqueName: \"kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.077184 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.077144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.077384 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.077258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m697v\" (UniqueName: \"kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.077384 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.077320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.077636 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.077605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.077733 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.077715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.084889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.084859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m697v\" (UniqueName: \"kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.149511 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.149434 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:54.275844 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.275820 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6"] Jun 07 16:09:54.277955 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:09:54.277928 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e2eca8_2ae4_49a5_bca6_87b87c89a948.slice/crio-587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593 WatchSource:0}: Error finding container 587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593: Status 404 returned error can't find the container with id 587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593 Jun 07 16:09:54.740334 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.740303 2561 generic.go:356] "Generic (PLEG): container finished" podID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerID="bcdcf9d0e4a43b6cfabef6cc03309c4be6efaf39b4c7e77dc9cf9a73f582e338" exitCode=0 Jun 07 16:09:54.740503 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.740396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" event={"ID":"36e2eca8-2ae4-49a5-bca6-87b87c89a948","Type":"ContainerDied","Data":"bcdcf9d0e4a43b6cfabef6cc03309c4be6efaf39b4c7e77dc9cf9a73f582e338"} Jun 07 16:09:54.740503 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:54.740447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" event={"ID":"36e2eca8-2ae4-49a5-bca6-87b87c89a948","Type":"ContainerStarted","Data":"587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593"} Jun 07 16:09:55.746745 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:55.746711 2561 generic.go:356] "Generic (PLEG): container finished" podID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerID="ec5f904015fb3f474e38fe0dd117221a1f8ba3be5854d520196752ad045b198a" exitCode=0 Jun 07 16:09:55.747116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:55.746799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" event={"ID":"36e2eca8-2ae4-49a5-bca6-87b87c89a948","Type":"ContainerDied","Data":"ec5f904015fb3f474e38fe0dd117221a1f8ba3be5854d520196752ad045b198a"} Jun 07 16:09:56.753019 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:56.752983 2561 generic.go:356] "Generic (PLEG): container finished" podID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerID="cf448c7074c753415b3076f3f22eaaa9f164299ea659cf6f7c58331d4792eda5" exitCode=0 Jun 07 16:09:56.753409 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:56.753071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" event={"ID":"36e2eca8-2ae4-49a5-bca6-87b87c89a948","Type":"ContainerDied","Data":"cf448c7074c753415b3076f3f22eaaa9f164299ea659cf6f7c58331d4792eda5"} Jun 07 16:09:57.881173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:57.881149 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:58.016656 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.016579 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util\") pod \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " Jun 07 16:09:58.016656 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.016631 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle\") pod \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " Jun 07 16:09:58.016858 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.016675 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m697v\" (UniqueName: \"kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v\") pod \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\" (UID: \"36e2eca8-2ae4-49a5-bca6-87b87c89a948\") " Jun 07 16:09:58.017308 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.017280 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle" (OuterVolumeSpecName: "bundle") pod "36e2eca8-2ae4-49a5-bca6-87b87c89a948" (UID: "36e2eca8-2ae4-49a5-bca6-87b87c89a948"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:58.018710 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.018689 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v" (OuterVolumeSpecName: "kube-api-access-m697v") pod "36e2eca8-2ae4-49a5-bca6-87b87c89a948" (UID: "36e2eca8-2ae4-49a5-bca6-87b87c89a948"). InnerVolumeSpecName "kube-api-access-m697v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:09:58.022066 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.022036 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util" (OuterVolumeSpecName: "util") pod "36e2eca8-2ae4-49a5-bca6-87b87c89a948" (UID: "36e2eca8-2ae4-49a5-bca6-87b87c89a948"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:09:58.117266 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.117228 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m697v\" (UniqueName: \"kubernetes.io/projected/36e2eca8-2ae4-49a5-bca6-87b87c89a948-kube-api-access-m697v\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:58.117266 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.117258 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:58.117266 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.117269 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e2eca8-2ae4-49a5-bca6-87b87c89a948-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:09:58.764792 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.764743 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" Jun 07 16:09:58.764792 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.764781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6lcq6" event={"ID":"36e2eca8-2ae4-49a5-bca6-87b87c89a948","Type":"ContainerDied","Data":"587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593"} Jun 07 16:09:58.764995 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:09:58.764823 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587361d62e1e6799772ee2eb4a9585e80966d835c079748ce35774b6b1a31593" Jun 07 16:10:07.733415 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733380 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf"] Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733856 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="util" Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733874 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="util" Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733884 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="pull" Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733892 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="pull" Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733905 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="extract" Jun 07 16:10:07.733915 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733914 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="extract" Jun 07 16:10:07.734220 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.733993 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e2eca8-2ae4-49a5-bca6-87b87c89a948" containerName="extract" Jun 07 16:10:07.737118 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.737094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.740723 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.740702 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:10:07.740723 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.740715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srqqz\"" Jun 07 16:10:07.740960 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.740790 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:10:07.741220 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.741206 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:10:07.742301 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.742280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:10:07.758357 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.758337 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf"] Jun 07 16:10:07.800172 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.800138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.800172 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.800177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.800429 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.800201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.800429 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.800306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.800429 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.800381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gskbk\" (UniqueName: \"kubernetes.io/projected/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-kube-api-access-gskbk\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.901802 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.901740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.901802 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.901806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.902070 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.901835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.902070 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.901876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.902070 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.901923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gskbk\" (UniqueName: \"kubernetes.io/projected/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-kube-api-access-gskbk\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.902325 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.902296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.904223 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.904194 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.904372 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.904351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.904422 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.904365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:07.914351 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:07.914327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gskbk\" (UniqueName: \"kubernetes.io/projected/d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3-kube-api-access-gskbk\") pod \"opendatahub-operator-controller-manager-79675d457c-szflf\" (UID: \"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:08.048441 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:08.048409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:08.187564 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:08.187355 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf"] Jun 07 16:10:08.190472 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:08.190444 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c8ce2b_cbce_4d03_85bb_922d8f24e8c3.slice/crio-835621796c6920f6fcf12678073022205108f08fcd034f7fa5cb8a98d316cf8a WatchSource:0}: Error finding container 835621796c6920f6fcf12678073022205108f08fcd034f7fa5cb8a98d316cf8a: Status 404 returned error can't find the container with id 835621796c6920f6fcf12678073022205108f08fcd034f7fa5cb8a98d316cf8a Jun 07 16:10:08.814933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:08.814855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" event={"ID":"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3","Type":"ContainerStarted","Data":"835621796c6920f6fcf12678073022205108f08fcd034f7fa5cb8a98d316cf8a"} Jun 07 16:10:11.832467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:11.832421 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" event={"ID":"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3","Type":"ContainerStarted","Data":"125b51e5df79a8fbee6d39c061b6ca4320d1df43a52d2503eada1fe112a0e265"} Jun 07 16:10:12.838644 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:12.838613 2561 generic.go:356] "Generic (PLEG): container finished" podID="d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3" containerID="125b51e5df79a8fbee6d39c061b6ca4320d1df43a52d2503eada1fe112a0e265" exitCode=0 Jun 07 16:10:12.839053 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:12.838674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" event={"ID":"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3","Type":"ContainerDied","Data":"125b51e5df79a8fbee6d39c061b6ca4320d1df43a52d2503eada1fe112a0e265"} Jun 07 16:10:13.846086 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:13.846039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" event={"ID":"d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3","Type":"ContainerStarted","Data":"b8b4ae07022a277110f307a212cf816b0a03bf9fedbbd6c008f71410eb6ebbd1"} Jun 07 16:10:13.846484 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:13.846134 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:13.867797 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:13.867729 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" podStartSLOduration=2.509764945 podStartE2EDuration="6.867714334s" totalImagesPullingTime="3.313832596s" totalInitContainerRuntime="1.044116793s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:13.865124183 +0000 UTC m=+502.342573878" watchObservedRunningTime="2026-06-07 16:10:13.867714334 +0000 UTC m=+502.345164016" Jun 07 16:10:24.852534 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:24.852501 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-szflf" Jun 07 16:10:26.692504 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.692468 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-r8l88"] Jun 07 16:10:26.700681 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.700651 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.703074 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.703055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 16:10:26.703186 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.703065 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 16:10:26.710727 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.710704 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-r8l88"] Jun 07 16:10:26.776738 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.776701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a3341f-901e-4f87-98a6-068341e0a39b-tmp\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.776946 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.776746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knm7r\" (UniqueName: \"kubernetes.io/projected/74a3341f-901e-4f87-98a6-068341e0a39b-kube-api-access-knm7r\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.776946 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.776815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.878093 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.878060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.878260 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.878128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a3341f-901e-4f87-98a6-068341e0a39b-tmp\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.878260 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.878149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knm7r\" (UniqueName: \"kubernetes.io/projected/74a3341f-901e-4f87-98a6-068341e0a39b-kube-api-access-knm7r\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.878260 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:26.878226 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 07 16:10:26.878406 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:26.878332 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs podName:74a3341f-901e-4f87-98a6-068341e0a39b nodeName:}" failed. No retries permitted until 2026-06-07 16:10:27.378309719 +0000 UTC m=+515.855759393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs") pod "kube-auth-proxy-746d4cf656-r8l88" (UID: "74a3341f-901e-4f87-98a6-068341e0a39b") : secret "kube-auth-proxy-tls" not found Jun 07 16:10:26.880263 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.880244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a3341f-901e-4f87-98a6-068341e0a39b-tmp\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:26.886464 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:26.886446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knm7r\" (UniqueName: \"kubernetes.io/projected/74a3341f-901e-4f87-98a6-068341e0a39b-kube-api-access-knm7r\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:27.365720 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.365684 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vxzn8"] Jun 07 16:10:27.369025 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.369009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.371518 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.371497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 07 16:10:27.371641 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.371500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w24vv\"" Jun 07 16:10:27.378262 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.378241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vxzn8"] Jun 07 16:10:27.383591 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.383564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:27.386073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.386039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74a3341f-901e-4f87-98a6-068341e0a39b-tls-certs\") pod \"kube-auth-proxy-746d4cf656-r8l88\" (UID: \"74a3341f-901e-4f87-98a6-068341e0a39b\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:27.484472 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.484435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcnj\" (UniqueName: \"kubernetes.io/projected/34dd6439-a329-41ed-9ddc-b76a9e6bf602-kube-api-access-hdcnj\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.484625 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.484504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.585152 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.585111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.585321 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.585171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcnj\" (UniqueName: \"kubernetes.io/projected/34dd6439-a329-41ed-9ddc-b76a9e6bf602-kube-api-access-hdcnj\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.585321 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:27.585279 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 07 16:10:27.585389 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:27.585348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert podName:34dd6439-a329-41ed-9ddc-b76a9e6bf602 nodeName:}" failed. No retries permitted until 2026-06-07 16:10:28.085329425 +0000 UTC m=+516.562779087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert") pod "odh-model-controller-6dc94f689f-vxzn8" (UID: "34dd6439-a329-41ed-9ddc-b76a9e6bf602") : secret "odh-model-controller-webhook-cert" not found Jun 07 16:10:27.593435 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.593401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcnj\" (UniqueName: \"kubernetes.io/projected/34dd6439-a329-41ed-9ddc-b76a9e6bf602-kube-api-access-hdcnj\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:27.611173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.611146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" Jun 07 16:10:27.740941 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.740915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-r8l88"] Jun 07 16:10:27.743395 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:27.743369 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a3341f_901e_4f87_98a6_068341e0a39b.slice/crio-9d1e134145529403df962a182886b12168b3b67822adbad2aa6e333f7a229213 WatchSource:0}: Error finding container 9d1e134145529403df962a182886b12168b3b67822adbad2aa6e333f7a229213: Status 404 returned error can't find the container with id 9d1e134145529403df962a182886b12168b3b67822adbad2aa6e333f7a229213 Jun 07 16:10:27.910853 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:27.910774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" event={"ID":"74a3341f-901e-4f87-98a6-068341e0a39b","Type":"ContainerStarted","Data":"9d1e134145529403df962a182886b12168b3b67822adbad2aa6e333f7a229213"} Jun 07 16:10:28.001598 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.001568 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-28jpf"] Jun 07 16:10:28.006912 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.006889 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.011733 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.011713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 07 16:10:28.025488 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.025467 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-28jpf"] Jun 07 16:10:28.088995 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.088962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4ml\" (UniqueName: \"kubernetes.io/projected/4915946a-ac49-456a-8ab7-323bf88a7092-kube-api-access-2s4ml\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.089153 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.089019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:28.089153 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.089088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4915946a-ac49-456a-8ab7-323bf88a7092-tls-certs\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.091280 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.091249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34dd6439-a329-41ed-9ddc-b76a9e6bf602-cert\") pod \"odh-model-controller-6dc94f689f-vxzn8\" (UID: \"34dd6439-a329-41ed-9ddc-b76a9e6bf602\") " pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:28.189967 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.189877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4915946a-ac49-456a-8ab7-323bf88a7092-tls-certs\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.189967 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.189952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4ml\" (UniqueName: \"kubernetes.io/projected/4915946a-ac49-456a-8ab7-323bf88a7092-kube-api-access-2s4ml\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.192967 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.192936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4915946a-ac49-456a-8ab7-323bf88a7092-tls-certs\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.198481 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.198452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4ml\" (UniqueName: \"kubernetes.io/projected/4915946a-ac49-456a-8ab7-323bf88a7092-kube-api-access-2s4ml\") pod \"model-serving-api-5dd488fc48-28jpf\" (UID: \"4915946a-ac49-456a-8ab7-323bf88a7092\") " pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.279875 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.279807 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:28.326942 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.326905 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:28.453290 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.453212 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vxzn8"] Jun 07 16:10:28.455998 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:28.455966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dd6439_a329_41ed_9ddc_b76a9e6bf602.slice/crio-efe04ef820dba33fd8afbb5c334a5d45d8c21cec25c2ab3bf5483c79128bbe62 WatchSource:0}: Error finding container efe04ef820dba33fd8afbb5c334a5d45d8c21cec25c2ab3bf5483c79128bbe62: Status 404 returned error can't find the container with id efe04ef820dba33fd8afbb5c334a5d45d8c21cec25c2ab3bf5483c79128bbe62 Jun 07 16:10:28.508448 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.508384 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-28jpf"] Jun 07 16:10:28.510430 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:28.510364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4915946a_ac49_456a_8ab7_323bf88a7092.slice/crio-71f50044230993e8c978e477672da10613e5470c422e3b620691a54b5c0d62f0 WatchSource:0}: Error finding container 71f50044230993e8c978e477672da10613e5470c422e3b620691a54b5c0d62f0: Status 404 returned error can't find the container with id 71f50044230993e8c978e477672da10613e5470c422e3b620691a54b5c0d62f0 Jun 07 16:10:28.918079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.918036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" event={"ID":"4915946a-ac49-456a-8ab7-323bf88a7092","Type":"ContainerStarted","Data":"71f50044230993e8c978e477672da10613e5470c422e3b620691a54b5c0d62f0"} Jun 07 16:10:28.919605 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:28.919574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" event={"ID":"34dd6439-a329-41ed-9ddc-b76a9e6bf602","Type":"ContainerStarted","Data":"efe04ef820dba33fd8afbb5c334a5d45d8c21cec25c2ab3bf5483c79128bbe62"} Jun 07 16:10:29.971801 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.971765 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z"] Jun 07 16:10:29.976972 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.976946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:29.979577 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.979549 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:10:29.980494 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.980469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:10:29.980494 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.980484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:10:29.986886 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:29.986175 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z"] Jun 07 16:10:30.110693 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.110653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.110908 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.110740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.110908 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.110815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx42x\" (UniqueName: \"kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.212332 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.212298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.212332 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.212335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.212593 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.212377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx42x\" (UniqueName: \"kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.212793 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.212737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.212868 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.212793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.221317 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.221292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx42x\" (UniqueName: \"kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.289863 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.289839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:30.494686 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.494665 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z"] Jun 07 16:10:30.496578 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:30.496551 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda210b7a7_deae_42d8_99b1_c8538f5f6ac1.slice/crio-b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789 WatchSource:0}: Error finding container b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789: Status 404 returned error can't find the container with id b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789 Jun 07 16:10:30.936329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.936245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" event={"ID":"74a3341f-901e-4f87-98a6-068341e0a39b","Type":"ContainerStarted","Data":"88905f3d8ff476cc1117c1fcbe4612ed34893a003444f1cec2a9c8fc2d1980dc"} Jun 07 16:10:30.938345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.938290 2561 generic.go:356] "Generic (PLEG): container finished" podID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerID="7937a358bf98234f421b3ed1f515e8054bc80d204a9ba0c8173c50778edbf83e" exitCode=0 Jun 07 16:10:30.938467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.938416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" event={"ID":"a210b7a7-deae-42d8-99b1-c8538f5f6ac1","Type":"ContainerDied","Data":"7937a358bf98234f421b3ed1f515e8054bc80d204a9ba0c8173c50778edbf83e"} Jun 07 16:10:30.938467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.938462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" event={"ID":"a210b7a7-deae-42d8-99b1-c8538f5f6ac1","Type":"ContainerStarted","Data":"b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789"} Jun 07 16:10:30.954985 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:30.954924 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-746d4cf656-r8l88" podStartSLOduration=2.27542422 podStartE2EDuration="4.954906109s" totalImagesPullingTime="2.679481889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:30.951435859 +0000 UTC m=+519.428885542" watchObservedRunningTime="2026-06-07 16:10:30.954906109 +0000 UTC m=+519.432355792" Jun 07 16:10:32.956042 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.955934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" event={"ID":"34dd6439-a329-41ed-9ddc-b76a9e6bf602","Type":"ContainerStarted","Data":"f260311a5a6d4dfaec31882bd3ce421b888b2055d20eb6c554587c4e19fcca49"} Jun 07 16:10:32.956485 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.956071 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:32.957589 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.957554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" event={"ID":"4915946a-ac49-456a-8ab7-323bf88a7092","Type":"ContainerStarted","Data":"3f722eac527855242128dfbe450dac5e68aa6f988fa68ace265f1d297cdae06a"} Jun 07 16:10:32.957722 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.957615 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:32.959437 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.959409 2561 generic.go:356] "Generic (PLEG): container finished" podID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerID="d1d858c33abe35cfacbeecde369d8d5505dfc2bac492cdac723d59c9b39141aa" exitCode=0 Jun 07 16:10:32.959532 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.959464 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" event={"ID":"a210b7a7-deae-42d8-99b1-c8538f5f6ac1","Type":"ContainerDied","Data":"d1d858c33abe35cfacbeecde369d8d5505dfc2bac492cdac723d59c9b39141aa"} Jun 07 16:10:32.973390 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.973325 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" podStartSLOduration=2.148406988 podStartE2EDuration="5.973305725s" totalImagesPullingTime="3.824898737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:32.970924246 +0000 UTC m=+521.448373929" watchObservedRunningTime="2026-06-07 16:10:32.973305725 +0000 UTC m=+521.450755408" Jun 07 16:10:32.986495 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:32.986448 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" podStartSLOduration=2.218074436 podStartE2EDuration="5.986430117s" totalImagesPullingTime="3.768355681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:32.984926215 +0000 UTC m=+521.462375923" watchObservedRunningTime="2026-06-07 16:10:32.986430117 +0000 UTC m=+521.463879800" Jun 07 16:10:33.966186 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:33.966148 2561 generic.go:356] "Generic (PLEG): container finished" podID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerID="cb4437934fb703d6446413ec67664d8e170067119358b7a862bef6f1ac5c1cda" exitCode=0 Jun 07 16:10:33.968310 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:33.968283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" event={"ID":"a210b7a7-deae-42d8-99b1-c8538f5f6ac1","Type":"ContainerDied","Data":"cb4437934fb703d6446413ec67664d8e170067119358b7a862bef6f1ac5c1cda"} Jun 07 16:10:35.119357 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.119330 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:35.260783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.260726 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx42x\" (UniqueName: \"kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x\") pod \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " Jun 07 16:10:35.260975 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.260833 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util\") pod \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " Jun 07 16:10:35.260975 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.260868 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle\") pod \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\" (UID: \"a210b7a7-deae-42d8-99b1-c8538f5f6ac1\") " Jun 07 16:10:35.261879 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.261846 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle" (OuterVolumeSpecName: "bundle") pod "a210b7a7-deae-42d8-99b1-c8538f5f6ac1" (UID: "a210b7a7-deae-42d8-99b1-c8538f5f6ac1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:10:35.262861 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.262830 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x" (OuterVolumeSpecName: "kube-api-access-mx42x") pod "a210b7a7-deae-42d8-99b1-c8538f5f6ac1" (UID: "a210b7a7-deae-42d8-99b1-c8538f5f6ac1"). InnerVolumeSpecName "kube-api-access-mx42x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:10:35.265709 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.265681 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util" (OuterVolumeSpecName: "util") pod "a210b7a7-deae-42d8-99b1-c8538f5f6ac1" (UID: "a210b7a7-deae-42d8-99b1-c8538f5f6ac1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:10:35.361631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.361591 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:35.361631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.361622 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:35.361631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.361633 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx42x\" (UniqueName: \"kubernetes.io/projected/a210b7a7-deae-42d8-99b1-c8538f5f6ac1-kube-api-access-mx42x\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:35.976958 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.976937 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" Jun 07 16:10:35.977097 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.976932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wlx5z" event={"ID":"a210b7a7-deae-42d8-99b1-c8538f5f6ac1","Type":"ContainerDied","Data":"b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789"} Jun 07 16:10:35.977097 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:35.977051 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b21b785bbaf51964cb81b10a99cd39c1bcd909edf61659ed38848f17b157d789" Jun 07 16:10:36.839422 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839387 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ztbvb"] Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839719 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="pull" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839729 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="pull" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839740 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="extract" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839746 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="extract" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839772 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="util" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839777 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="util" Jun 07 16:10:36.839830 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.839827 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a210b7a7-deae-42d8-99b1-c8538f5f6ac1" containerName="extract" Jun 07 16:10:36.842694 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.842677 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:36.846978 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.846954 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 07 16:10:36.847132 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.847044 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6jj7t\"" Jun 07 16:10:36.858198 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.858174 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4"] Jun 07 16:10:36.861192 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.861157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:36.864585 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.864567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-x8td6\"" Jun 07 16:10:36.864823 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.864807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 07 16:10:36.865673 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.865649 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ztbvb"] Jun 07 16:10:36.884408 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.884374 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4"] Jun 07 16:10:36.975933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.975897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22974af-b1ec-45d2-bcb7-5d9393765cda-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:36.976136 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.975954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8rpr\" (UniqueName: \"kubernetes.io/projected/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-kube-api-access-l8rpr\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:36.976136 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.975982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72g4\" (UniqueName: \"kubernetes.io/projected/a22974af-b1ec-45d2-bcb7-5d9393765cda-kube-api-access-z72g4\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:36.976136 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:36.976062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.077108 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.077075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72g4\" (UniqueName: \"kubernetes.io/projected/a22974af-b1ec-45d2-bcb7-5d9393765cda-kube-api-access-z72g4\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:37.077288 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.077141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.077288 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.077200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22974af-b1ec-45d2-bcb7-5d9393765cda-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:37.077288 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.077258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8rpr\" (UniqueName: \"kubernetes.io/projected/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-kube-api-access-l8rpr\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.077480 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:37.077261 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 07 16:10:37.077480 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:10:37.077355 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert podName:7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9 nodeName:}" failed. No retries permitted until 2026-06-07 16:10:37.57733386 +0000 UTC m=+526.054783525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert") pod "kserve-controller-manager-69fc866d76-ztbvb" (UID: "7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9") : secret "kserve-webhook-server-cert" not found Jun 07 16:10:37.079732 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.079710 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22974af-b1ec-45d2-bcb7-5d9393765cda-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:37.086781 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.086569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72g4\" (UniqueName: \"kubernetes.io/projected/a22974af-b1ec-45d2-bcb7-5d9393765cda-kube-api-access-z72g4\") pod \"llmisvc-controller-manager-864bfd7bc9-wtnw4\" (UID: \"a22974af-b1ec-45d2-bcb7-5d9393765cda\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:37.092871 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.092815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8rpr\" (UniqueName: \"kubernetes.io/projected/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-kube-api-access-l8rpr\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.172574 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.172535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:37.303773 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.303721 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4"] Jun 07 16:10:37.306179 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:37.306152 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda22974af_b1ec_45d2_bcb7_5d9393765cda.slice/crio-596ce9f382de1984d679430dde548ac3423904960f8027a62f1ab945deb614e8 WatchSource:0}: Error finding container 596ce9f382de1984d679430dde548ac3423904960f8027a62f1ab945deb614e8: Status 404 returned error can't find the container with id 596ce9f382de1984d679430dde548ac3423904960f8027a62f1ab945deb614e8 Jun 07 16:10:37.581374 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.581338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.583708 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.583688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9-cert\") pod \"kserve-controller-manager-69fc866d76-ztbvb\" (UID: \"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.753399 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.753363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:37.892342 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.892311 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ztbvb"] Jun 07 16:10:37.919648 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:37.919587 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0aee69_1c11_47cc_81c3_f0b54ed6d8e9.slice/crio-12cae0235a6697bf8ff28abb21e224e3f1afd01f1a1aa6bfe5cd74c65a83be5c WatchSource:0}: Error finding container 12cae0235a6697bf8ff28abb21e224e3f1afd01f1a1aa6bfe5cd74c65a83be5c: Status 404 returned error can't find the container with id 12cae0235a6697bf8ff28abb21e224e3f1afd01f1a1aa6bfe5cd74c65a83be5c Jun 07 16:10:37.989648 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.989608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" event={"ID":"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9","Type":"ContainerStarted","Data":"12cae0235a6697bf8ff28abb21e224e3f1afd01f1a1aa6bfe5cd74c65a83be5c"} Jun 07 16:10:37.990822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:37.990792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" event={"ID":"a22974af-b1ec-45d2-bcb7-5d9393765cda","Type":"ContainerStarted","Data":"596ce9f382de1984d679430dde548ac3423904960f8027a62f1ab945deb614e8"} Jun 07 16:10:42.012370 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.012336 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" event={"ID":"7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9","Type":"ContainerStarted","Data":"fd3703fa188dfbda564de16feee044dc5b627bc1716084b93c3a0aaf1ef415d2"} Jun 07 16:10:42.012810 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.012438 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:10:42.013953 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.013927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" event={"ID":"a22974af-b1ec-45d2-bcb7-5d9393765cda","Type":"ContainerStarted","Data":"fbb19f4f15e4a380cc0d3f821ed1cc07a6547d2e124003a7430bc247c54f075f"} Jun 07 16:10:42.014081 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.014063 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:10:42.030346 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.030297 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" podStartSLOduration=2.941583951 podStartE2EDuration="6.030282932s" totalImagesPullingTime="3.088698981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:42.028006678 +0000 UTC m=+530.505456380" watchObservedRunningTime="2026-06-07 16:10:42.030282932 +0000 UTC m=+530.507732642" Jun 07 16:10:42.042852 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:42.042806 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" podStartSLOduration=2.337058355 podStartE2EDuration="6.042789129s" totalImagesPullingTime="3.705730774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:42.04250534 +0000 UTC m=+530.519955023" watchObservedRunningTime="2026-06-07 16:10:42.042789129 +0000 UTC m=+530.520238813" Jun 07 16:10:43.968769 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:43.968722 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-vxzn8" Jun 07 16:10:43.970874 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:43.970852 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-28jpf" Jun 07 16:10:44.780890 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.780855 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6"] Jun 07 16:10:44.787542 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.787522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.792142 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.792118 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:10:44.792277 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.792154 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:10:44.793167 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.793148 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:10:44.807582 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.807557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6"] Jun 07 16:10:44.846119 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.846086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swkds\" (UniqueName: \"kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.846283 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.846130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.846283 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.846197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.946841 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.946806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swkds\" (UniqueName: \"kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.946841 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.946847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.947064 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.946886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.947277 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.947256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.947318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.947289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:44.968642 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:44.968612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swkds\" (UniqueName: \"kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:45.096384 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:45.096303 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:45.230707 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:45.230674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6"] Jun 07 16:10:45.234522 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:45.234496 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde64f2a_7ae5_45fe_93e6_5cf2644ca309.slice/crio-b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c WatchSource:0}: Error finding container b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c: Status 404 returned error can't find the container with id b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c Jun 07 16:10:46.035816 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.035717 2561 generic.go:356] "Generic (PLEG): container finished" podID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerID="05a4df3f7ecbaeb94db75aad0f737972f156c9bf9d7a7651a4880348a33a69b0" exitCode=0 Jun 07 16:10:46.035816 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.035794 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" event={"ID":"bde64f2a-7ae5-45fe-93e6-5cf2644ca309","Type":"ContainerDied","Data":"05a4df3f7ecbaeb94db75aad0f737972f156c9bf9d7a7651a4880348a33a69b0"} Jun 07 16:10:46.036053 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.035847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" event={"ID":"bde64f2a-7ae5-45fe-93e6-5cf2644ca309","Type":"ContainerStarted","Data":"b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c"} Jun 07 16:10:46.220408 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.220374 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-scpjz"] Jun 07 16:10:46.223811 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.223745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.227018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.227002 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qb4md\"" Jun 07 16:10:46.227018 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.227009 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 07 16:10:46.227260 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.227247 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 07 16:10:46.255429 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.255403 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-scpjz"] Jun 07 16:10:46.257491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.257464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aa7d2045-1df4-40a2-afd0-507cededc559-operator-config\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.257590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.257560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5czj\" (UniqueName: \"kubernetes.io/projected/aa7d2045-1df4-40a2-afd0-507cededc559-kube-api-access-g5czj\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.358367 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.358336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aa7d2045-1df4-40a2-afd0-507cededc559-operator-config\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.358499 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.358400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5czj\" (UniqueName: \"kubernetes.io/projected/aa7d2045-1df4-40a2-afd0-507cededc559-kube-api-access-g5czj\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.360718 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.360691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aa7d2045-1df4-40a2-afd0-507cededc559-operator-config\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.368318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.368297 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5czj\" (UniqueName: \"kubernetes.io/projected/aa7d2045-1df4-40a2-afd0-507cededc559-kube-api-access-g5czj\") pod \"servicemesh-operator3-57f65f65fb-scpjz\" (UID: \"aa7d2045-1df4-40a2-afd0-507cededc559\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.532943 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.532909 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:46.674228 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:46.674204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-scpjz"] Jun 07 16:10:46.676463 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:46.676431 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7d2045_1df4_40a2_afd0_507cededc559.slice/crio-0038ee8afaf3a0f5194bfd39b0fe83162368d92daefd02ce7d4a4e3a137f2211 WatchSource:0}: Error finding container 0038ee8afaf3a0f5194bfd39b0fe83162368d92daefd02ce7d4a4e3a137f2211: Status 404 returned error can't find the container with id 0038ee8afaf3a0f5194bfd39b0fe83162368d92daefd02ce7d4a4e3a137f2211 Jun 07 16:10:47.047981 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:47.047944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" event={"ID":"aa7d2045-1df4-40a2-afd0-507cededc559","Type":"ContainerStarted","Data":"0038ee8afaf3a0f5194bfd39b0fe83162368d92daefd02ce7d4a4e3a137f2211"} Jun 07 16:10:47.049708 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:47.049682 2561 generic.go:356] "Generic (PLEG): container finished" podID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerID="00bba692222d2f646f48afb325cc72d200a6cc9b901c963a84192ef79601f22d" exitCode=0 Jun 07 16:10:47.049821 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:47.049770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" event={"ID":"bde64f2a-7ae5-45fe-93e6-5cf2644ca309","Type":"ContainerDied","Data":"00bba692222d2f646f48afb325cc72d200a6cc9b901c963a84192ef79601f22d"} Jun 07 16:10:48.058703 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:48.058658 2561 generic.go:356] "Generic (PLEG): container finished" podID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerID="8081f292d908cd3283089f20bdd6e782419f0ebdbab3908978ed93a943dc4857" exitCode=0 Jun 07 16:10:48.059124 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:48.058743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" event={"ID":"bde64f2a-7ae5-45fe-93e6-5cf2644ca309","Type":"ContainerDied","Data":"8081f292d908cd3283089f20bdd6e782419f0ebdbab3908978ed93a943dc4857"} Jun 07 16:10:49.202414 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.202388 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:49.286172 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.286130 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle\") pod \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " Jun 07 16:10:49.286405 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.286186 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util\") pod \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " Jun 07 16:10:49.286405 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.286277 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swkds\" (UniqueName: \"kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds\") pod \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\" (UID: \"bde64f2a-7ae5-45fe-93e6-5cf2644ca309\") " Jun 07 16:10:49.287369 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.287334 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle" (OuterVolumeSpecName: "bundle") pod "bde64f2a-7ae5-45fe-93e6-5cf2644ca309" (UID: "bde64f2a-7ae5-45fe-93e6-5cf2644ca309"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:10:49.289419 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.289369 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds" (OuterVolumeSpecName: "kube-api-access-swkds") pod "bde64f2a-7ae5-45fe-93e6-5cf2644ca309" (UID: "bde64f2a-7ae5-45fe-93e6-5cf2644ca309"). InnerVolumeSpecName "kube-api-access-swkds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:10:49.294445 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.294363 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util" (OuterVolumeSpecName: "util") pod "bde64f2a-7ae5-45fe-93e6-5cf2644ca309" (UID: "bde64f2a-7ae5-45fe-93e6-5cf2644ca309"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:10:49.387285 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.387168 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swkds\" (UniqueName: \"kubernetes.io/projected/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-kube-api-access-swkds\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:49.387285 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.387206 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:49.387285 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:49.387221 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bde64f2a-7ae5-45fe-93e6-5cf2644ca309-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:10:50.071023 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.070991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" event={"ID":"aa7d2045-1df4-40a2-afd0-507cededc559","Type":"ContainerStarted","Data":"af6530069876dcc8ec926ee14ae721110acae68a21a955ef952e09b9189ca6cb"} Jun 07 16:10:50.071207 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.071048 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:10:50.072880 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.072861 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" Jun 07 16:10:50.072981 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.072878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abtgc6" event={"ID":"bde64f2a-7ae5-45fe-93e6-5cf2644ca309","Type":"ContainerDied","Data":"b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c"} Jun 07 16:10:50.072981 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.072911 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9f7bd7d2ac041fc73bdcd65a4f8a282317500e4392a015716345fb0dc87785c" Jun 07 16:10:50.091805 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:50.091746 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" podStartSLOduration=1.687663321 podStartE2EDuration="4.091731383s" totalImagesPullingTime="2.404068062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:50.090479632 +0000 UTC m=+538.567929321" watchObservedRunningTime="2026-06-07 16:10:50.091731383 +0000 UTC m=+538.569181065" Jun 07 16:10:57.086535 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.086499 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-6pnpl"] Jun 07 16:10:57.087044 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087027 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="pull" Jun 07 16:10:57.087128 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087047 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="pull" Jun 07 16:10:57.087128 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087078 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="util" Jun 07 16:10:57.087128 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087087 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="util" Jun 07 16:10:57.087128 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087102 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="extract" Jun 07 16:10:57.087128 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087111 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="extract" Jun 07 16:10:57.087349 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.087200 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde64f2a-7ae5-45fe-93e6-5cf2644ca309" containerName="extract" Jun 07 16:10:57.092291 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.092271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.094606 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.094583 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 16:10:57.094723 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.094710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hlg86\"" Jun 07 16:10:57.098093 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.098047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-6pnpl"] Jun 07 16:10:57.156177 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.156140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e6db1ca-80a6-4b8f-846c-d58197e5e300-redirect-config\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.156177 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.156182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbm6g\" (UniqueName: \"kubernetes.io/projected/0e6db1ca-80a6-4b8f-846c-d58197e5e300-kube-api-access-jbm6g\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.257705 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.257665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e6db1ca-80a6-4b8f-846c-d58197e5e300-redirect-config\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.257705 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.257704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm6g\" (UniqueName: \"kubernetes.io/projected/0e6db1ca-80a6-4b8f-846c-d58197e5e300-kube-api-access-jbm6g\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.258414 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.258395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e6db1ca-80a6-4b8f-846c-d58197e5e300-redirect-config\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.265363 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.265333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbm6g\" (UniqueName: \"kubernetes.io/projected/0e6db1ca-80a6-4b8f-846c-d58197e5e300-kube-api-access-jbm6g\") pod \"dashboard-redirect-558f5455c4-6pnpl\" (UID: \"0e6db1ca-80a6-4b8f-846c-d58197e5e300\") " pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.404599 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.404530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" Jun 07 16:10:57.532970 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:57.532939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-6pnpl"] Jun 07 16:10:57.534447 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:10:57.534421 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6db1ca_80a6_4b8f_846c_d58197e5e300.slice/crio-2069db8fcf4dd86cdbda1cb0ffde13b129807d2f550c49b248119931d49f7201 WatchSource:0}: Error finding container 2069db8fcf4dd86cdbda1cb0ffde13b129807d2f550c49b248119931d49f7201: Status 404 returned error can't find the container with id 2069db8fcf4dd86cdbda1cb0ffde13b129807d2f550c49b248119931d49f7201 Jun 07 16:10:58.118626 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:10:58.118592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" event={"ID":"0e6db1ca-80a6-4b8f-846c-d58197e5e300","Type":"ContainerStarted","Data":"2069db8fcf4dd86cdbda1cb0ffde13b129807d2f550c49b248119931d49f7201"} Jun 07 16:11:00.131547 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:00.131508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" event={"ID":"0e6db1ca-80a6-4b8f-846c-d58197e5e300","Type":"ContainerStarted","Data":"854884dc6902b343a34328bcb08d6af766cba99907c900b24d809c3b0f844f1c"} Jun 07 16:11:00.146177 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:00.146131 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-558f5455c4-6pnpl" podStartSLOduration=1.237220072 podStartE2EDuration="3.146116007s" totalImagesPullingTime="1.908895935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:00.144770776 +0000 UTC m=+548.622220451" watchObservedRunningTime="2026-06-07 16:11:00.146116007 +0000 UTC m=+548.623565690" Jun 07 16:11:01.079710 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:01.079681 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-scpjz" Jun 07 16:11:13.021541 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:13.021508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wtnw4" Jun 07 16:11:13.024739 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:13.024717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ztbvb" Jun 07 16:11:16.337388 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.337350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds"] Jun 07 16:11:16.342885 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.342863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.345203 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.345177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 07 16:11:16.345328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.345212 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xdg7q\"" Jun 07 16:11:16.345328 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.345261 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 07 16:11:16.345422 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.345402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 07 16:11:16.345627 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.345609 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 16:11:16.350013 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.349947 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds"] Jun 07 16:11:16.429914 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.429879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lct\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-kube-api-access-t2lct\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.429923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.430017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430079 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.430072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/519a8d70-033c-4d2a-af79-b89ffda973d8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430186 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.430106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430186 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.430158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.430358 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.430187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531395 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lct\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-kube-api-access-t2lct\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531395 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531600 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531600 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/519a8d70-033c-4d2a-af79-b89ffda973d8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531600 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.531876 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.531841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.532104 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.532081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.533956 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.533926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/519a8d70-033c-4d2a-af79-b89ffda973d8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.534080 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.534027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.534143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.534109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.534258 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.534236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.539043 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.539021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.539401 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.539375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lct\" (UniqueName: \"kubernetes.io/projected/519a8d70-033c-4d2a-af79-b89ffda973d8-kube-api-access-t2lct\") pod \"istiod-openshift-gateway-75c67f8887-dl5ds\" (UID: \"519a8d70-033c-4d2a-af79-b89ffda973d8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.653552 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.653444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:16.801714 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:16.801684 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds"] Jun 07 16:11:16.803745 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:11:16.803706 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519a8d70_033c_4d2a_af79_b89ffda973d8.slice/crio-b42f11ba85c56c14e8ad99546f03c335d23a9fc2428a41b75184dacfd3a8c3c7 WatchSource:0}: Error finding container b42f11ba85c56c14e8ad99546f03c335d23a9fc2428a41b75184dacfd3a8c3c7: Status 404 returned error can't find the container with id b42f11ba85c56c14e8ad99546f03c335d23a9fc2428a41b75184dacfd3a8c3c7 Jun 07 16:11:17.219514 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:17.219480 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" event={"ID":"519a8d70-033c-4d2a-af79-b89ffda973d8","Type":"ContainerStarted","Data":"b42f11ba85c56c14e8ad99546f03c335d23a9fc2428a41b75184dacfd3a8c3c7"} Jun 07 16:11:19.796345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:19.796306 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 07 16:11:19.796609 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:19.796376 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 07 16:11:20.240364 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:20.240332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" event={"ID":"519a8d70-033c-4d2a-af79-b89ffda973d8","Type":"ContainerStarted","Data":"cf1ec9030469552b95e95b42d446624c6011fcfb4ad4de68ea3caec7828119d4"} Jun 07 16:11:20.240572 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:20.240554 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:20.242483 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:20.242459 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-dl5ds container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 07 16:11:20.242609 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:20.242516 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" podUID="519a8d70-033c-4d2a-af79-b89ffda973d8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:11:20.260616 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:20.260570 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" podStartSLOduration=1.27049846 podStartE2EDuration="4.260553334s" totalImagesPullingTime="2.990054874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:20.258348803 +0000 UTC m=+568.735798488" watchObservedRunningTime="2026-06-07 16:11:20.260553334 +0000 UTC m=+568.738003017" Jun 07 16:11:21.246446 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:21.246418 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dl5ds" Jun 07 16:11:43.948615 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.948577 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k"] Jun 07 16:11:43.952109 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.952093 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:43.954387 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.954364 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:11:43.954502 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.954416 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:11:43.954502 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.954425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5h6z\"" Jun 07 16:11:43.959790 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.959734 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k"] Jun 07 16:11:43.986215 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.986180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpj4\" (UniqueName: \"kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:43.986376 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.986234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:43.986376 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:43.986344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.086816 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.086785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpj4\" (UniqueName: \"kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.086968 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.086919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.087029 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.087015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.087274 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.087258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.087318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.087292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.094478 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.094454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpj4\" (UniqueName: \"kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.262450 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.262414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:44.431553 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.431529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k"] Jun 07 16:11:44.433013 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:11:44.432975 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3a85e0_0bc7_4937_b826_52aaaaccceaf.slice/crio-d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b WatchSource:0}: Error finding container d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b: Status 404 returned error can't find the container with id d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b Jun 07 16:11:44.750360 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.750324 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh"] Jun 07 16:11:44.753912 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.753894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.761743 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.761721 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh"] Jun 07 16:11:44.794514 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.794435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.794654 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.794553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c8v6\" (UniqueName: \"kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.794654 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.794624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.895672 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.895638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c8v6\" (UniqueName: \"kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.895865 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.895683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.895865 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.895714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.896073 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.896057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.896109 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.896096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:44.903198 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:44.903179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c8v6\" (UniqueName: \"kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:45.063836 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.063739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:45.197514 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.197487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh"] Jun 07 16:11:45.199001 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:11:45.198966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7afc8c_21ac_4048_9a7e_74ab99ff038c.slice/crio-73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31 WatchSource:0}: Error finding container 73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31: Status 404 returned error can't find the container with id 73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31 Jun 07 16:11:45.374193 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.374106 2561 generic.go:356] "Generic (PLEG): container finished" podID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerID="b48a2e277900f7821a5b4a4ff76f84f3f21e27a8548636fe596c643bb396c313" exitCode=0 Jun 07 16:11:45.374346 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.374192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" event={"ID":"cf7afc8c-21ac-4048-9a7e-74ab99ff038c","Type":"ContainerDied","Data":"b48a2e277900f7821a5b4a4ff76f84f3f21e27a8548636fe596c643bb396c313"} Jun 07 16:11:45.374346 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.374246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" event={"ID":"cf7afc8c-21ac-4048-9a7e-74ab99ff038c","Type":"ContainerStarted","Data":"73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31"} Jun 07 16:11:45.375904 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.375884 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerID="0623758fe0f92502c5354453f5ffd0a0a152862311c76c89e74e189bd2210f1c" exitCode=0 Jun 07 16:11:45.376054 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.375930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" event={"ID":"2f3a85e0-0bc7-4937-b826-52aaaaccceaf","Type":"ContainerDied","Data":"0623758fe0f92502c5354453f5ffd0a0a152862311c76c89e74e189bd2210f1c"} Jun 07 16:11:45.376054 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.375962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" event={"ID":"2f3a85e0-0bc7-4937-b826-52aaaaccceaf","Type":"ContainerStarted","Data":"d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b"} Jun 07 16:11:45.544639 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.544604 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c"] Jun 07 16:11:45.548352 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.548331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.555180 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.555157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c"] Jun 07 16:11:45.602281 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.602248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.602453 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.602286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.602453 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.602331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65fnp\" (UniqueName: \"kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.703641 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.703542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.703641 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.703590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.703641 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.703630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65fnp\" (UniqueName: \"kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.704044 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.704024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.704124 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.704079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.711355 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.711328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65fnp\" (UniqueName: \"kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.858498 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.858458 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:45.999523 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:45.999490 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c"] Jun 07 16:11:46.001057 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:11:46.001026 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3415c3a0_ba9a_4ecb_a5fa_e5ee5e4b22f3.slice/crio-1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471 WatchSource:0}: Error finding container 1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471: Status 404 returned error can't find the container with id 1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471 Jun 07 16:11:46.150610 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.150565 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4"] Jun 07 16:11:46.155078 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.155048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.161261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.161233 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4"] Jun 07 16:11:46.209783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.208564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7hv6\" (UniqueName: \"kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.209783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.208636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.209783 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.208696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.309199 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.309167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7hv6\" (UniqueName: \"kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.309199 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.309208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.309421 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.309250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.309624 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.309605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.309694 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.309634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.317465 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.317433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7hv6\" (UniqueName: \"kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.386684 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.386649 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" event={"ID":"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3","Type":"ContainerStarted","Data":"1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471"} Jun 07 16:11:46.470229 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.470193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:46.607656 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:46.607628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4"] Jun 07 16:11:46.609368 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:11:46.609340 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50da1fed_d050_458d_8395_86156b4ade0a.slice/crio-42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32 WatchSource:0}: Error finding container 42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32: Status 404 returned error can't find the container with id 42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32 Jun 07 16:11:47.394378 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.394292 2561 generic.go:356] "Generic (PLEG): container finished" podID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerID="251d554bf093950c6e5dbc20ea9253ff49c9874b005f9083e9c8969c6c251b70" exitCode=0 Jun 07 16:11:47.394823 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.394380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" event={"ID":"cf7afc8c-21ac-4048-9a7e-74ab99ff038c","Type":"ContainerDied","Data":"251d554bf093950c6e5dbc20ea9253ff49c9874b005f9083e9c8969c6c251b70"} Jun 07 16:11:47.396020 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.395995 2561 generic.go:356] "Generic (PLEG): container finished" podID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerID="bc2853502f5beefd8e8c1e7a8a730cf3a434db185e488d920bfbd42b67e90579" exitCode=0 Jun 07 16:11:47.396145 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.396078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" event={"ID":"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3","Type":"ContainerDied","Data":"bc2853502f5beefd8e8c1e7a8a730cf3a434db185e488d920bfbd42b67e90579"} Jun 07 16:11:47.397689 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.397658 2561 generic.go:356] "Generic (PLEG): container finished" podID="50da1fed-d050-458d-8395-86156b4ade0a" containerID="9622cdfb1054e55f7c78659f87a7fac128f22098d9498233784c66541e174ddf" exitCode=0 Jun 07 16:11:47.397801 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.397705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" event={"ID":"50da1fed-d050-458d-8395-86156b4ade0a","Type":"ContainerDied","Data":"9622cdfb1054e55f7c78659f87a7fac128f22098d9498233784c66541e174ddf"} Jun 07 16:11:47.397801 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.397767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" event={"ID":"50da1fed-d050-458d-8395-86156b4ade0a","Type":"ContainerStarted","Data":"42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32"} Jun 07 16:11:47.399889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.399866 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerID="d31716e03d52c34ba969c0140d3ba27cd14f254dcbb7aaf52a4d1fa01c31aa82" exitCode=0 Jun 07 16:11:47.399970 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:47.399921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" event={"ID":"2f3a85e0-0bc7-4937-b826-52aaaaccceaf","Type":"ContainerDied","Data":"d31716e03d52c34ba969c0140d3ba27cd14f254dcbb7aaf52a4d1fa01c31aa82"} Jun 07 16:11:48.408386 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.408296 2561 generic.go:356] "Generic (PLEG): container finished" podID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerID="1ccb8663c63d0a08699d5d097babcf5483ae98d466e40eead890cf766191fa13" exitCode=0 Jun 07 16:11:48.408803 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.408387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" event={"ID":"cf7afc8c-21ac-4048-9a7e-74ab99ff038c","Type":"ContainerDied","Data":"1ccb8663c63d0a08699d5d097babcf5483ae98d466e40eead890cf766191fa13"} Jun 07 16:11:48.410221 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.410197 2561 generic.go:356] "Generic (PLEG): container finished" podID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerID="ad2421ac5af006793c091766d4e19a5dcac629a0f73b5ad188c1618123034f5c" exitCode=0 Jun 07 16:11:48.410338 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.410264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" event={"ID":"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3","Type":"ContainerDied","Data":"ad2421ac5af006793c091766d4e19a5dcac629a0f73b5ad188c1618123034f5c"} Jun 07 16:11:48.412228 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.412203 2561 generic.go:356] "Generic (PLEG): container finished" podID="50da1fed-d050-458d-8395-86156b4ade0a" containerID="7bcbab8838880fca3f380c34e0b1601f81b5e90a683f6a5c7e8beeaedf19e891" exitCode=0 Jun 07 16:11:48.412341 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.412287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" event={"ID":"50da1fed-d050-458d-8395-86156b4ade0a","Type":"ContainerDied","Data":"7bcbab8838880fca3f380c34e0b1601f81b5e90a683f6a5c7e8beeaedf19e891"} Jun 07 16:11:48.414631 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.414613 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerID="4e2802988bc33576192f453f3118e7d6b3a04260cfdb1b7a7d1876bd4670a577" exitCode=0 Jun 07 16:11:48.414714 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:48.414646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" event={"ID":"2f3a85e0-0bc7-4937-b826-52aaaaccceaf","Type":"ContainerDied","Data":"4e2802988bc33576192f453f3118e7d6b3a04260cfdb1b7a7d1876bd4670a577"} Jun 07 16:11:49.430692 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.430603 2561 generic.go:356] "Generic (PLEG): container finished" podID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerID="10bd4f8d67f63d9769e2a658234389bd1cc62e7b3b3d977c9cd994eefc5aa8fd" exitCode=0 Jun 07 16:11:49.431205 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.430688 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" event={"ID":"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3","Type":"ContainerDied","Data":"10bd4f8d67f63d9769e2a658234389bd1cc62e7b3b3d977c9cd994eefc5aa8fd"} Jun 07 16:11:49.432824 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.432802 2561 generic.go:356] "Generic (PLEG): container finished" podID="50da1fed-d050-458d-8395-86156b4ade0a" containerID="945f486c4015a14e6036c94c4599f542de0a603ca5394cbda2b5bcce52ea4a78" exitCode=0 Jun 07 16:11:49.432953 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.432874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" event={"ID":"50da1fed-d050-458d-8395-86156b4ade0a","Type":"ContainerDied","Data":"945f486c4015a14e6036c94c4599f542de0a603ca5394cbda2b5bcce52ea4a78"} Jun 07 16:11:49.570562 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.570537 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:49.599134 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.599108 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:49.640377 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640354 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util\") pod \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " Jun 07 16:11:49.640506 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640383 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle\") pod \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " Jun 07 16:11:49.640506 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640416 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c8v6\" (UniqueName: \"kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6\") pod \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " Jun 07 16:11:49.640506 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640495 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle\") pod \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " Jun 07 16:11:49.640671 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640514 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqpj4\" (UniqueName: \"kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4\") pod \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\" (UID: \"2f3a85e0-0bc7-4937-b826-52aaaaccceaf\") " Jun 07 16:11:49.640671 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640533 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util\") pod \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\" (UID: \"cf7afc8c-21ac-4048-9a7e-74ab99ff038c\") " Jun 07 16:11:49.640982 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.640950 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle" (OuterVolumeSpecName: "bundle") pod "2f3a85e0-0bc7-4937-b826-52aaaaccceaf" (UID: "2f3a85e0-0bc7-4937-b826-52aaaaccceaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:49.641127 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.641091 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle" (OuterVolumeSpecName: "bundle") pod "cf7afc8c-21ac-4048-9a7e-74ab99ff038c" (UID: "cf7afc8c-21ac-4048-9a7e-74ab99ff038c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:49.642704 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.642678 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4" (OuterVolumeSpecName: "kube-api-access-kqpj4") pod "2f3a85e0-0bc7-4937-b826-52aaaaccceaf" (UID: "2f3a85e0-0bc7-4937-b826-52aaaaccceaf"). InnerVolumeSpecName "kube-api-access-kqpj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:11:49.642822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.642708 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6" (OuterVolumeSpecName: "kube-api-access-6c8v6") pod "cf7afc8c-21ac-4048-9a7e-74ab99ff038c" (UID: "cf7afc8c-21ac-4048-9a7e-74ab99ff038c"). InnerVolumeSpecName "kube-api-access-6c8v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:11:49.648773 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.648734 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util" (OuterVolumeSpecName: "util") pod "2f3a85e0-0bc7-4937-b826-52aaaaccceaf" (UID: "2f3a85e0-0bc7-4937-b826-52aaaaccceaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:49.649140 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.649121 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util" (OuterVolumeSpecName: "util") pod "cf7afc8c-21ac-4048-9a7e-74ab99ff038c" (UID: "cf7afc8c-21ac-4048-9a7e-74ab99ff038c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:49.741372 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741347 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:49.741487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741390 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:49.741487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741400 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c8v6\" (UniqueName: \"kubernetes.io/projected/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-kube-api-access-6c8v6\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:49.741487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741411 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:49.741487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741419 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqpj4\" (UniqueName: \"kubernetes.io/projected/2f3a85e0-0bc7-4937-b826-52aaaaccceaf-kube-api-access-kqpj4\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:49.741487 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:49.741428 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf7afc8c-21ac-4048-9a7e-74ab99ff038c-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.440116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.440046 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" Jun 07 16:11:50.440116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.440056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k" event={"ID":"2f3a85e0-0bc7-4937-b826-52aaaaccceaf","Type":"ContainerDied","Data":"d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b"} Jun 07 16:11:50.440116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.440101 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1eaf8f1c2ee0c1d293d3b76e68cb87a664ca54eef44a17336236b7ccc7ac33b" Jun 07 16:11:50.442015 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.441994 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" Jun 07 16:11:50.442174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.442040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh" event={"ID":"cf7afc8c-21ac-4048-9a7e-74ab99ff038c","Type":"ContainerDied","Data":"73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31"} Jun 07 16:11:50.442174 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.442096 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73cb78ffd5523af89099c48e4a465e6cf4ec0878b145d261c6a42f2092c30c31" Jun 07 16:11:50.580681 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.580654 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:50.607738 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.607714 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:50.650356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.650334 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7hv6\" (UniqueName: \"kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6\") pod \"50da1fed-d050-458d-8395-86156b4ade0a\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " Jun 07 16:11:50.650464 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.650387 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util\") pod \"50da1fed-d050-458d-8395-86156b4ade0a\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " Jun 07 16:11:50.650464 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.650427 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle\") pod \"50da1fed-d050-458d-8395-86156b4ade0a\" (UID: \"50da1fed-d050-458d-8395-86156b4ade0a\") " Jun 07 16:11:50.651055 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.651031 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle" (OuterVolumeSpecName: "bundle") pod "50da1fed-d050-458d-8395-86156b4ade0a" (UID: "50da1fed-d050-458d-8395-86156b4ade0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:50.652312 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.652293 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6" (OuterVolumeSpecName: "kube-api-access-m7hv6") pod "50da1fed-d050-458d-8395-86156b4ade0a" (UID: "50da1fed-d050-458d-8395-86156b4ade0a"). InnerVolumeSpecName "kube-api-access-m7hv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:11:50.655592 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.655572 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util" (OuterVolumeSpecName: "util") pod "50da1fed-d050-458d-8395-86156b4ade0a" (UID: "50da1fed-d050-458d-8395-86156b4ade0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:50.751353 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751330 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle\") pod \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " Jun 07 16:11:50.751469 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751399 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util\") pod \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " Jun 07 16:11:50.751469 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751424 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65fnp\" (UniqueName: \"kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp\") pod \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\" (UID: \"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3\") " Jun 07 16:11:50.751564 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751552 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7hv6\" (UniqueName: \"kubernetes.io/projected/50da1fed-d050-458d-8395-86156b4ade0a-kube-api-access-m7hv6\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.751613 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751565 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.751613 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751573 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50da1fed-d050-458d-8395-86156b4ade0a-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.751904 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.751871 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle" (OuterVolumeSpecName: "bundle") pod "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" (UID: "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:50.753438 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.753421 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp" (OuterVolumeSpecName: "kube-api-access-65fnp") pod "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" (UID: "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3"). InnerVolumeSpecName "kube-api-access-65fnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:11:50.756889 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.756871 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util" (OuterVolumeSpecName: "util") pod "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" (UID: "3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:11:50.852610 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.852586 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.852610 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.852606 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:50.852610 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:50.852615 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65fnp\" (UniqueName: \"kubernetes.io/projected/3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3-kube-api-access-65fnp\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:11:51.449701 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.449621 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" Jun 07 16:11:51.449701 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.449631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c" event={"ID":"3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3","Type":"ContainerDied","Data":"1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471"} Jun 07 16:11:51.449701 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.449678 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1733bd05912763307a0402f44b4a685a9ad63d546b0a26c07a2a9a45b4e66471" Jun 07 16:11:51.451536 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.451518 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" Jun 07 16:11:51.451668 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.451534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4" event={"ID":"50da1fed-d050-458d-8395-86156b4ade0a","Type":"ContainerDied","Data":"42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32"} Jun 07 16:11:51.451668 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.451577 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42d93637b8594a5049d8daf7ce9bf4c9317f014e56f2e904a5dfc5f703173f32" Jun 07 16:11:51.976298 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.976270 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:11:51.978106 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:51.978085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:11:52.345596 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:11:52.345564 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:12:08.468247 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468216 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg"] Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468568 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468579 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468586 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468591 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468602 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468608 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468615 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468620 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468628 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468633 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468642 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468647 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468657 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468662 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="util" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468667 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468672 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468678 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468683 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468690 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468695 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="pull" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468704 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468710 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468717 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468722 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468796 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50da1fed-d050-458d-8395-86156b4ade0a" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468807 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3a85e0-0bc7-4937-b826-52aaaaccceaf" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468812 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7afc8c-21ac-4048-9a7e-74ab99ff038c" containerName="extract" Jun 07 16:12:08.470546 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.468819 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3" containerName="extract" Jun 07 16:12:08.471695 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.471680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:08.474143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.474120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:12:08.474267 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.474144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ck8hq\"" Jun 07 16:12:08.474267 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.474132 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:12:08.482922 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.482899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg"] Jun 07 16:12:08.617179 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.617145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8gg\" (UniqueName: \"kubernetes.io/projected/818fa32f-9eb5-4cee-840e-9338d9562a76-kube-api-access-rn8gg\") pod \"authorino-operator-75cc8d5cb7-b7pgg\" (UID: \"818fa32f-9eb5-4cee-840e-9338d9562a76\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:08.717799 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.717733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8gg\" (UniqueName: \"kubernetes.io/projected/818fa32f-9eb5-4cee-840e-9338d9562a76-kube-api-access-rn8gg\") pod \"authorino-operator-75cc8d5cb7-b7pgg\" (UID: \"818fa32f-9eb5-4cee-840e-9338d9562a76\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:08.728080 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.728007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8gg\" (UniqueName: \"kubernetes.io/projected/818fa32f-9eb5-4cee-840e-9338d9562a76-kube-api-access-rn8gg\") pod \"authorino-operator-75cc8d5cb7-b7pgg\" (UID: \"818fa32f-9eb5-4cee-840e-9338d9562a76\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:08.782650 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.782608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:08.922695 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:08.922669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg"] Jun 07 16:12:08.924406 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:12:08.924385 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818fa32f_9eb5_4cee_840e_9338d9562a76.slice/crio-b07e980c3db180337d43c07ef905f6f0b18d7c57a9c8326b5b4c6fffc3256a3f WatchSource:0}: Error finding container b07e980c3db180337d43c07ef905f6f0b18d7c57a9c8326b5b4c6fffc3256a3f: Status 404 returned error can't find the container with id b07e980c3db180337d43c07ef905f6f0b18d7c57a9c8326b5b4c6fffc3256a3f Jun 07 16:12:09.551261 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:09.551221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" event={"ID":"818fa32f-9eb5-4cee-840e-9338d9562a76","Type":"ContainerStarted","Data":"b07e980c3db180337d43c07ef905f6f0b18d7c57a9c8326b5b4c6fffc3256a3f"} Jun 07 16:12:11.565196 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:11.565163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" event={"ID":"818fa32f-9eb5-4cee-840e-9338d9562a76","Type":"ContainerStarted","Data":"a83c340a578f585ccd6a457333e09680c5351adbfd9c3b028aaf2eb9985fac72"} Jun 07 16:12:11.565589 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:11.565292 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:11.582432 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:11.582381 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" podStartSLOduration=1.349060691 podStartE2EDuration="3.582365951s" totalImagesPullingTime="2.23330526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:11.581130957 +0000 UTC m=+620.058580641" watchObservedRunningTime="2026-06-07 16:12:11.582365951 +0000 UTC m=+620.059815633" Jun 07 16:12:17.366901 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.366859 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59bcd88d87-4vj8p" podUID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" containerName="console" containerID="cri-o://5191a0b546401113646fec708b85a1ee8f4445e0daa4a45c0d135da12ba55c25" gracePeriod=15 Jun 07 16:12:17.601006 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.600976 2561 generic.go:356] "Generic (PLEG): container finished" podID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" containerID="5191a0b546401113646fec708b85a1ee8f4445e0daa4a45c0d135da12ba55c25" exitCode=0 Jun 07 16:12:17.601158 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.601046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bcd88d87-4vj8p" event={"ID":"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0","Type":"ContainerDied","Data":"5191a0b546401113646fec708b85a1ee8f4445e0daa4a45c0d135da12ba55c25"} Jun 07 16:12:17.617272 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.617216 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:12:17.795372 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795330 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795568 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795384 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795568 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795423 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795568 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795442 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795568 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795546 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795587 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795609 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2drvb\" (UniqueName: \"kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb\") pod \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\" (UID: \"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0\") " Jun 07 16:12:17.795903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.795868 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:12:17.796251 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.796226 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:12:17.796415 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.796386 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config" (OuterVolumeSpecName: "console-config") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:12:17.796496 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.796075 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:12:17.797821 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.797794 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:12:17.798116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.798093 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:12:17.798211 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.798123 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb" (OuterVolumeSpecName: "kube-api-access-2drvb") pod "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" (UID: "8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0"). InnerVolumeSpecName "kube-api-access-2drvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896802 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-oauth-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896832 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-oauth-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896841 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-service-ca\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896851 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-config\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896859 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2drvb\" (UniqueName: \"kubernetes.io/projected/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-kube-api-access-2drvb\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896869 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-console-serving-cert\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:17.896893 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:17.896877 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0-trusted-ca-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:18.607955 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:18.607927 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bcd88d87-4vj8p" Jun 07 16:12:18.607955 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:18.607942 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bcd88d87-4vj8p" event={"ID":"8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0","Type":"ContainerDied","Data":"cb7cc6f02f714e8f68e6a5e0f25a18ff650d45a4817f9a88b4bf6dfb80187700"} Jun 07 16:12:18.608407 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:18.607996 2561 scope.go:117] "RemoveContainer" containerID="5191a0b546401113646fec708b85a1ee8f4445e0daa4a45c0d135da12ba55c25" Jun 07 16:12:18.624721 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:18.624696 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:12:18.628495 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:18.628473 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bcd88d87-4vj8p"] Jun 07 16:12:19.969849 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:19.969807 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" path="/var/lib/kubelet/pods/8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0/volumes" Jun 07 16:12:22.572999 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:22.572971 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b7pgg" Jun 07 16:12:24.717977 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.717942 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs"] Jun 07 16:12:24.718391 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.718378 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" containerName="console" Jun 07 16:12:24.718440 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.718393 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" containerName="console" Jun 07 16:12:24.718474 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.718452 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0d542d-a71c-4c8f-bdf9-7385cc8a77f0" containerName="console" Jun 07 16:12:24.723413 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.723393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.726089 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.726067 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9wrrz\"" Jun 07 16:12:24.734342 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.734319 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs"] Jun 07 16:12:24.755458 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.755421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.755581 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.755478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqpm\" (UniqueName: \"kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.856590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.856556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.856746 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.856606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqpm\" (UniqueName: \"kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.857004 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.856981 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:24.866294 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:24.866269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqpm\" (UniqueName: \"kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.034195 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.034160 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.136387 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.136355 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs"] Jun 07 16:12:25.141465 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.141439 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs"] Jun 07 16:12:25.154714 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.154684 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:25.159659 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.159574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.169990 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.169942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:25.260059 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.260017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.260228 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.260113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45th\" (UniqueName: \"kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.311436 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:12:25.311401 2561 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 07 16:12:25.311436 ip-10-0-142-225 kubenswrapper[2561]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zxtfs_kuadrant-system_e68244d2-bfbf-4570-b192-a439758e5c23_0(b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zxtfs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f" Netns:"/var/run/netns/83defa94-2175-45e2-9e8e-a1c4ec2334ca" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-zxtfs;K8S_POD_INFRA_CONTAINER_ID=b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f;K8S_POD_UID=e68244d2-bfbf-4570-b192-a439758e5c23" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs/e68244d2-bfbf-4570-b192-a439758e5c23:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:2d [10.133.0.45/23] Jun 07 16:12:25.311436 ip-10-0-142-225 kubenswrapper[2561]: ' Jun 07 16:12:25.311436 ip-10-0-142-225 kubenswrapper[2561]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 07 16:12:25.311436 ip-10-0-142-225 kubenswrapper[2561]: > Jun 07 16:12:25.311641 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:12:25.311462 2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 07 16:12:25.311641 ip-10-0-142-225 kubenswrapper[2561]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zxtfs_kuadrant-system_e68244d2-bfbf-4570-b192-a439758e5c23_0(b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zxtfs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f" Netns:"/var/run/netns/83defa94-2175-45e2-9e8e-a1c4ec2334ca" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-zxtfs;K8S_POD_INFRA_CONTAINER_ID=b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f;K8S_POD_UID=e68244d2-bfbf-4570-b192-a439758e5c23" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs/e68244d2-bfbf-4570-b192-a439758e5c23:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs b748331ddbf53f10bbfce8247598b2c1d307a5b09ae6f97e9a11c397ab7c864f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:2d [10.133.0.45/23] Jun 07 16:12:25.311641 ip-10-0-142-225 kubenswrapper[2561]: ' Jun 07 16:12:25.311641 ip-10-0-142-225 kubenswrapper[2561]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 07 16:12:25.311641 ip-10-0-142-225 kubenswrapper[2561]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.361143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.361103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g45th\" (UniqueName: \"kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.361316 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.361235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.361587 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.361568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.371158 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.371133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45th\" (UniqueName: \"kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th\") pod \"kuadrant-operator-controller-manager-55467d9f7-jvvv6\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.474274 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.474243 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:25.611906 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.611880 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:25.613485 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:12:25.613461 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9fe3e0_ac5a_4331_bfce_bf6b251644c3.slice/crio-8eb376820c7560a17ecbea244a26416e78ce003759b5e534317721dbbade3ec6 WatchSource:0}: Error finding container 8eb376820c7560a17ecbea244a26416e78ce003759b5e534317721dbbade3ec6: Status 404 returned error can't find the container with id 8eb376820c7560a17ecbea244a26416e78ce003759b5e534317721dbbade3ec6 Jun 07 16:12:25.649478 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.649449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" event={"ID":"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3","Type":"ContainerStarted","Data":"8eb376820c7560a17ecbea244a26416e78ce003759b5e534317721dbbade3ec6"} Jun 07 16:12:25.649583 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.649509 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.651676 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:12:25.651651 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" is forbidden: User \"system:node:ip-10-0-142-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-225.ec2.internal' and this object" podUID="e68244d2-bfbf-4570-b192-a439758e5c23" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.657248 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.657232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.659332 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:12:25.659311 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" is forbidden: User \"system:node:ip-10-0-142-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-225.ec2.internal' and this object" podUID="e68244d2-bfbf-4570-b192-a439758e5c23" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:25.764077 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.764046 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume\") pod \"e68244d2-bfbf-4570-b192-a439758e5c23\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " Jun 07 16:12:25.764431 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.764108 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kqpm\" (UniqueName: \"kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm\") pod \"e68244d2-bfbf-4570-b192-a439758e5c23\" (UID: \"e68244d2-bfbf-4570-b192-a439758e5c23\") " Jun 07 16:12:25.764431 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.764335 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e68244d2-bfbf-4570-b192-a439758e5c23" (UID: "e68244d2-bfbf-4570-b192-a439758e5c23"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:12:25.766224 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.766205 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm" (OuterVolumeSpecName: "kube-api-access-6kqpm") pod "e68244d2-bfbf-4570-b192-a439758e5c23" (UID: "e68244d2-bfbf-4570-b192-a439758e5c23"). InnerVolumeSpecName "kube-api-access-6kqpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:25.865317 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.865230 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e68244d2-bfbf-4570-b192-a439758e5c23-extensions-socket-volume\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.865317 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.865260 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kqpm\" (UniqueName: \"kubernetes.io/projected/e68244d2-bfbf-4570-b192-a439758e5c23-kube-api-access-6kqpm\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.970220 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:25.970188 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68244d2-bfbf-4570-b192-a439758e5c23" path="/var/lib/kubelet/pods/e68244d2-bfbf-4570-b192-a439758e5c23/volumes" Jun 07 16:12:26.662460 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:26.662429 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:26.667791 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:12:26.667733 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zxtfs\" is forbidden: User \"system:node:ip-10-0-142-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-225.ec2.internal' and this object" podUID="e68244d2-bfbf-4570-b192-a439758e5c23" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zxtfs" Jun 07 16:12:29.688072 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:29.688035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" event={"ID":"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3","Type":"ContainerStarted","Data":"f5f5c36842a0374ac46b2998b717ed0d652b004d025881777d0f9d3a0a90b0bc"} Jun 07 16:12:29.688419 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:29.688138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:29.709066 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:29.709023 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" podStartSLOduration=0.731230509 podStartE2EDuration="4.709008605s" totalImagesPullingTime="3.977778096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:29.70702908 +0000 UTC m=+638.184478762" watchObservedRunningTime="2026-06-07 16:12:29.709008605 +0000 UTC m=+638.186458288" Jun 07 16:12:40.697010 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:40.696977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:52.639708 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:52.639674 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:52.640314 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:52.640069 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" podUID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" containerName="manager" containerID="cri-o://f5f5c36842a0374ac46b2998b717ed0d652b004d025881777d0f9d3a0a90b0bc" gracePeriod=10 Jun 07 16:12:52.842158 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:52.840263 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" containerID="f5f5c36842a0374ac46b2998b717ed0d652b004d025881777d0f9d3a0a90b0bc" exitCode=0 Jun 07 16:12:52.842158 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:52.840441 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" event={"ID":"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3","Type":"ContainerDied","Data":"f5f5c36842a0374ac46b2998b717ed0d652b004d025881777d0f9d3a0a90b0bc"} Jun 07 16:12:52.905974 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:52.905953 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:53.006173 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.006137 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g45th\" (UniqueName: \"kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th\") pod \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " Jun 07 16:12:53.006370 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.006184 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume\") pod \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\" (UID: \"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3\") " Jun 07 16:12:53.006597 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.006570 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" (UID: "aa9fe3e0-ac5a-4331-bfce-bf6b251644c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:12:53.008251 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.008227 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th" (OuterVolumeSpecName: "kube-api-access-g45th") pod "aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" (UID: "aa9fe3e0-ac5a-4331-bfce-bf6b251644c3"). InnerVolumeSpecName "kube-api-access-g45th". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:53.107526 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.107484 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g45th\" (UniqueName: \"kubernetes.io/projected/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-kube-api-access-g45th\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:53.107526 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.107520 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3-extensions-socket-volume\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:12:53.846910 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.846874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" event={"ID":"aa9fe3e0-ac5a-4331-bfce-bf6b251644c3","Type":"ContainerDied","Data":"8eb376820c7560a17ecbea244a26416e78ce003759b5e534317721dbbade3ec6"} Jun 07 16:12:53.847329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.846932 2561 scope.go:117] "RemoveContainer" containerID="f5f5c36842a0374ac46b2998b717ed0d652b004d025881777d0f9d3a0a90b0bc" Jun 07 16:12:53.847329 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.846883 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6" Jun 07 16:12:53.873930 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.873897 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:53.879252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.879222 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jvvv6"] Jun 07 16:12:53.969572 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:12:53.969536 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" path="/var/lib/kubelet/pods/aa9fe3e0-ac5a-4331-bfce-bf6b251644c3/volumes" Jun 07 16:13:12.413378 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.413345 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:12.413848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.413700 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" containerName="manager" Jun 07 16:13:12.413848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.413711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" containerName="manager" Jun 07 16:13:12.413848 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.413795 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9fe3e0-ac5a-4331-bfce-bf6b251644c3" containerName="manager" Jun 07 16:13:12.416345 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.416330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.418702 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.418678 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 16:13:12.418870 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.418775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5h6z\"" Jun 07 16:13:12.424620 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.424597 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:12.474116 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.474069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.474241 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.474212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtzbz\" (UniqueName: \"kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.514540 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.514499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:12.575104 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.575077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzbz\" (UniqueName: \"kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.575258 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.575128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.575707 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.575691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.582444 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.582413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtzbz\" (UniqueName: \"kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz\") pod \"limitador-limitador-64c94fd64f-wppgb\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.727579 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.727496 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:12.870794 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.870769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:12.872367 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:13:12.872343 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba19afe3_a9ed_46c7_a612_5c375ae11496.slice/crio-5cfd7ce7ed7e73c146de3fb1aee3a328da96918417ee6de75e1b57273a94abe5 WatchSource:0}: Error finding container 5cfd7ce7ed7e73c146de3fb1aee3a328da96918417ee6de75e1b57273a94abe5: Status 404 returned error can't find the container with id 5cfd7ce7ed7e73c146de3fb1aee3a328da96918417ee6de75e1b57273a94abe5 Jun 07 16:13:12.955164 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:12.955129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" event={"ID":"ba19afe3-a9ed-46c7-a612-5c375ae11496","Type":"ContainerStarted","Data":"5cfd7ce7ed7e73c146de3fb1aee3a328da96918417ee6de75e1b57273a94abe5"} Jun 07 16:13:15.975202 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:15.975111 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" event={"ID":"ba19afe3-a9ed-46c7-a612-5c375ae11496","Type":"ContainerStarted","Data":"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b"} Jun 07 16:13:15.975549 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:15.975250 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:15.991590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:15.991534 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" podStartSLOduration=1.2800460519999999 podStartE2EDuration="3.991520671s" totalImagesPullingTime="2.711474619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:15.990059281 +0000 UTC m=+684.467508964" watchObservedRunningTime="2026-06-07 16:13:15.991520671 +0000 UTC m=+684.468970351" Jun 07 16:13:26.981645 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:26.981616 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:27.817004 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:27.816965 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:27.817212 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:27.817182 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" podUID="ba19afe3-a9ed-46c7-a612-5c375ae11496" containerName="limitador" containerID="cri-o://3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b" gracePeriod=30 Jun 07 16:13:28.363590 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.363571 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:28.413006 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.412935 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file\") pod \"ba19afe3-a9ed-46c7-a612-5c375ae11496\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " Jun 07 16:13:28.413123 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.413051 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtzbz\" (UniqueName: \"kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz\") pod \"ba19afe3-a9ed-46c7-a612-5c375ae11496\" (UID: \"ba19afe3-a9ed-46c7-a612-5c375ae11496\") " Jun 07 16:13:28.413274 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.413252 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file" (OuterVolumeSpecName: "config-file") pod "ba19afe3-a9ed-46c7-a612-5c375ae11496" (UID: "ba19afe3-a9ed-46c7-a612-5c375ae11496"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:13:28.415004 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.414977 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz" (OuterVolumeSpecName: "kube-api-access-mtzbz") pod "ba19afe3-a9ed-46c7-a612-5c375ae11496" (UID: "ba19afe3-a9ed-46c7-a612-5c375ae11496"). InnerVolumeSpecName "kube-api-access-mtzbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:13:28.514625 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.514598 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtzbz\" (UniqueName: \"kubernetes.io/projected/ba19afe3-a9ed-46c7-a612-5c375ae11496-kube-api-access-mtzbz\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:13:28.514625 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:28.514621 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba19afe3-a9ed-46c7-a612-5c375ae11496-config-file\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:13:29.046861 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.046826 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba19afe3-a9ed-46c7-a612-5c375ae11496" containerID="3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b" exitCode=0 Jun 07 16:13:29.047042 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.046887 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" Jun 07 16:13:29.047042 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.046914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" event={"ID":"ba19afe3-a9ed-46c7-a612-5c375ae11496","Type":"ContainerDied","Data":"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b"} Jun 07 16:13:29.047042 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.046972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wppgb" event={"ID":"ba19afe3-a9ed-46c7-a612-5c375ae11496","Type":"ContainerDied","Data":"5cfd7ce7ed7e73c146de3fb1aee3a328da96918417ee6de75e1b57273a94abe5"} Jun 07 16:13:29.047042 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.047001 2561 scope.go:117] "RemoveContainer" containerID="3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b" Jun 07 16:13:29.056354 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.056338 2561 scope.go:117] "RemoveContainer" containerID="3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b" Jun 07 16:13:29.056601 ip-10-0-142-225 kubenswrapper[2561]: E0607 16:13:29.056582 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b\": container with ID starting with 3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b not found: ID does not exist" containerID="3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b" Jun 07 16:13:29.056649 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.056609 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b"} err="failed to get container status \"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b\": rpc error: code = NotFound desc = could not find container \"3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b\": container with ID starting with 3aa1970ca092d16d1351e335ddc5218b510cb0b4c92701ec3108af6654527a7b not found: ID does not exist" Jun 07 16:13:29.068559 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.068529 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:29.071840 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.071818 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wppgb"] Jun 07 16:13:29.968905 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:29.968871 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba19afe3-a9ed-46c7-a612-5c375ae11496" path="/var/lib/kubelet/pods/ba19afe3-a9ed-46c7-a612-5c375ae11496/volumes" Jun 07 16:13:32.477510 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.477475 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs"] Jun 07 16:13:32.477938 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.477923 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba19afe3-a9ed-46c7-a612-5c375ae11496" containerName="limitador" Jun 07 16:13:32.477999 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.477940 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba19afe3-a9ed-46c7-a612-5c375ae11496" containerName="limitador" Jun 07 16:13:32.478043 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.478007 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba19afe3-a9ed-46c7-a612-5c375ae11496" containerName="limitador" Jun 07 16:13:32.482413 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.482396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.484819 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.484798 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 07 16:13:32.485576 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.485563 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 07 16:13:32.485650 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.485565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 07 16:13:32.485650 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.485592 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-jplr8\"" Jun 07 16:13:32.492338 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.492319 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs"] Jun 07 16:13:32.551433 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.551399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv6fx\" (UniqueName: \"kubernetes.io/projected/c9567610-0013-4c12-9597-b329db33edff-kube-api-access-xv6fx\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.551588 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.551465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9567610-0013-4c12-9597-b329db33edff-data\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.652619 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.652590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9567610-0013-4c12-9597-b329db33edff-data\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.652796 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.652641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv6fx\" (UniqueName: \"kubernetes.io/projected/c9567610-0013-4c12-9597-b329db33edff-kube-api-access-xv6fx\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.652982 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.652964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c9567610-0013-4c12-9597-b329db33edff-data\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.674879 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.674850 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv6fx\" (UniqueName: \"kubernetes.io/projected/c9567610-0013-4c12-9597-b329db33edff-kube-api-access-xv6fx\") pod \"postgres-69fb4594cf-mv5bs\" (UID: \"c9567610-0013-4c12-9597-b329db33edff\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.793363 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.793323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:32.930248 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:32.930226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs"] Jun 07 16:13:32.931578 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:13:32.931550 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9567610_0013_4c12_9597_b329db33edff.slice/crio-e25915e0be14ee7f39ec83adedaca9a326e731eca647a7c043e8b42d8fa55b17 WatchSource:0}: Error finding container e25915e0be14ee7f39ec83adedaca9a326e731eca647a7c043e8b42d8fa55b17: Status 404 returned error can't find the container with id e25915e0be14ee7f39ec83adedaca9a326e731eca647a7c043e8b42d8fa55b17 Jun 07 16:13:33.071076 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:33.070996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" event={"ID":"c9567610-0013-4c12-9597-b329db33edff","Type":"ContainerStarted","Data":"e25915e0be14ee7f39ec83adedaca9a326e731eca647a7c043e8b42d8fa55b17"} Jun 07 16:13:36.093519 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:36.093480 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" event={"ID":"c9567610-0013-4c12-9597-b329db33edff","Type":"ContainerStarted","Data":"c47b6f60b8e3da161a8c5f9ef4afb4f5c1875c9655b5502d1a4f78c7caa3aaea"} Jun 07 16:13:36.093964 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:36.093555 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:36.109866 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:36.109820 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" podStartSLOduration=1.722048459 podStartE2EDuration="4.109805059s" totalImagesPullingTime="2.3877566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:36.106960723 +0000 UTC m=+704.584410403" watchObservedRunningTime="2026-06-07 16:13:36.109805059 +0000 UTC m=+704.587254741" Jun 07 16:13:42.136892 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:42.136863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-mv5bs" Jun 07 16:13:43.507377 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.507338 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5"] Jun 07 16:13:43.513391 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.513363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.516008 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.515975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:13:43.516167 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.515982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vnj\"" Jun 07 16:13:43.516923 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.516901 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:13:43.520318 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.520298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5"] Jun 07 16:13:43.651926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.651886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.651926 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.651925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.652160 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.651973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25vfh\" (UniqueName: \"kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.752884 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.752854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25vfh\" (UniqueName: \"kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.753055 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.752935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.753055 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.752967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.753290 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.753271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.753338 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.753321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.763169 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.763110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25vfh\" (UniqueName: \"kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.824513 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.824491 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:43.954260 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:43.954228 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5"] Jun 07 16:13:43.955316 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:13:43.955279 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db70203_76aa_4f31_beea_7bde5cc9f1ac.slice/crio-476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5 WatchSource:0}: Error finding container 476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5: Status 404 returned error can't find the container with id 476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5 Jun 07 16:13:44.139061 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:44.139022 2561 generic.go:356] "Generic (PLEG): container finished" podID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerID="a130175ffccf8c03e31c4e84c7ffe4619c1525e97f648940f55e886f247c0327" exitCode=0 Jun 07 16:13:44.139210 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:44.139064 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" event={"ID":"2db70203-76aa-4f31-beea-7bde5cc9f1ac","Type":"ContainerDied","Data":"a130175ffccf8c03e31c4e84c7ffe4619c1525e97f648940f55e886f247c0327"} Jun 07 16:13:44.139210 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:44.139110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" event={"ID":"2db70203-76aa-4f31-beea-7bde5cc9f1ac","Type":"ContainerStarted","Data":"476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5"} Jun 07 16:13:45.147013 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:45.146980 2561 generic.go:356] "Generic (PLEG): container finished" podID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerID="1a737823b335c9588db30245e7713fb1769e983f2b0884e572f78e9811e30643" exitCode=0 Jun 07 16:13:45.147438 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:45.147044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" event={"ID":"2db70203-76aa-4f31-beea-7bde5cc9f1ac","Type":"ContainerDied","Data":"1a737823b335c9588db30245e7713fb1769e983f2b0884e572f78e9811e30643"} Jun 07 16:13:46.155115 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:46.155084 2561 generic.go:356] "Generic (PLEG): container finished" podID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerID="6232d13c0d639f50d8c7b7846bf4dd92493f0fda97c6ce3dae13a9253e444ebf" exitCode=0 Jun 07 16:13:46.155554 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:46.155176 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" event={"ID":"2db70203-76aa-4f31-beea-7bde5cc9f1ac","Type":"ContainerDied","Data":"6232d13c0d639f50d8c7b7846bf4dd92493f0fda97c6ce3dae13a9253e444ebf"} Jun 07 16:13:47.310447 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.310419 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:47.386618 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.386588 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle\") pod \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " Jun 07 16:13:47.386618 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.386625 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25vfh\" (UniqueName: \"kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh\") pod \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " Jun 07 16:13:47.386858 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.386669 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util\") pod \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\" (UID: \"2db70203-76aa-4f31-beea-7bde5cc9f1ac\") " Jun 07 16:13:47.387200 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.387161 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle" (OuterVolumeSpecName: "bundle") pod "2db70203-76aa-4f31-beea-7bde5cc9f1ac" (UID: "2db70203-76aa-4f31-beea-7bde5cc9f1ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:13:47.388646 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.388627 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh" (OuterVolumeSpecName: "kube-api-access-25vfh") pod "2db70203-76aa-4f31-beea-7bde5cc9f1ac" (UID: "2db70203-76aa-4f31-beea-7bde5cc9f1ac"). InnerVolumeSpecName "kube-api-access-25vfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:13:47.394432 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.394408 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util" (OuterVolumeSpecName: "util") pod "2db70203-76aa-4f31-beea-7bde5cc9f1ac" (UID: "2db70203-76aa-4f31-beea-7bde5cc9f1ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:13:47.487681 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.487653 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25vfh\" (UniqueName: \"kubernetes.io/projected/2db70203-76aa-4f31-beea-7bde5cc9f1ac-kube-api-access-25vfh\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:13:47.487681 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.487680 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-util\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:13:47.487892 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:47.487689 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db70203-76aa-4f31-beea-7bde5cc9f1ac-bundle\") on node \"ip-10-0-142-225.ec2.internal\" DevicePath \"\"" Jun 07 16:13:48.169385 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:48.169350 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" event={"ID":"2db70203-76aa-4f31-beea-7bde5cc9f1ac","Type":"ContainerDied","Data":"476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5"} Jun 07 16:13:48.169385 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:48.169368 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748zvhx5" Jun 07 16:13:48.169604 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:48.169399 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="476e01b59d126a46820fc11deafb69ebf21c19e4cf858a1cffbdbd62220ea8f5" Jun 07 16:13:51.123395 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123347 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w4x82"] Jun 07 16:13:51.123795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123732 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="extract" Jun 07 16:13:51.123795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123744 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="extract" Jun 07 16:13:51.123795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123771 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="util" Jun 07 16:13:51.123795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123782 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="util" Jun 07 16:13:51.123795 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123797 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="pull" Jun 07 16:13:51.123960 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123802 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="pull" Jun 07 16:13:51.123960 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.123861 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db70203-76aa-4f31-beea-7bde5cc9f1ac" containerName="extract" Jun 07 16:13:51.126025 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.126011 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" Jun 07 16:13:51.128467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.128447 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:13:51.128467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.128458 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:13:51.128646 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.128566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-kd5jh\"" Jun 07 16:13:51.136143 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.136124 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w4x82"] Jun 07 16:13:51.220035 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.220002 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpdmf\" (UniqueName: \"kubernetes.io/projected/299b37f4-dcb6-4db6-9a6a-67cbe3f27295-kube-api-access-rpdmf\") pod \"keycloak-operator-d67dbbb48-w4x82\" (UID: \"299b37f4-dcb6-4db6-9a6a-67cbe3f27295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" Jun 07 16:13:51.320683 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.320651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpdmf\" (UniqueName: \"kubernetes.io/projected/299b37f4-dcb6-4db6-9a6a-67cbe3f27295-kube-api-access-rpdmf\") pod \"keycloak-operator-d67dbbb48-w4x82\" (UID: \"299b37f4-dcb6-4db6-9a6a-67cbe3f27295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" Jun 07 16:13:51.329382 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.329357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpdmf\" (UniqueName: \"kubernetes.io/projected/299b37f4-dcb6-4db6-9a6a-67cbe3f27295-kube-api-access-rpdmf\") pod \"keycloak-operator-d67dbbb48-w4x82\" (UID: \"299b37f4-dcb6-4db6-9a6a-67cbe3f27295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" Jun 07 16:13:51.437180 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.437113 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" Jun 07 16:13:51.564722 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:51.564695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w4x82"] Jun 07 16:13:51.565318 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:13:51.565293 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299b37f4_dcb6_4db6_9a6a_67cbe3f27295.slice/crio-683bcf80e6ffd4ce14275656f16a2d367b6d7aae3e135346e57bc2dbd057f69d WatchSource:0}: Error finding container 683bcf80e6ffd4ce14275656f16a2d367b6d7aae3e135346e57bc2dbd057f69d: Status 404 returned error can't find the container with id 683bcf80e6ffd4ce14275656f16a2d367b6d7aae3e135346e57bc2dbd057f69d Jun 07 16:13:52.196427 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:52.196347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" event={"ID":"299b37f4-dcb6-4db6-9a6a-67cbe3f27295","Type":"ContainerStarted","Data":"683bcf80e6ffd4ce14275656f16a2d367b6d7aae3e135346e57bc2dbd057f69d"} Jun 07 16:13:57.233292 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:57.233249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" event={"ID":"299b37f4-dcb6-4db6-9a6a-67cbe3f27295","Type":"ContainerStarted","Data":"ba6e9c8c21dd2a4368f2e24776ddf47ccfbd3fc391dd94f086fa655454eb0748"} Jun 07 16:13:57.250210 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:13:57.250167 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-w4x82" podStartSLOduration=0.724511073 podStartE2EDuration="6.250154409s" totalImagesPullingTime="5.525643336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:57.247732048 +0000 UTC m=+725.725181754" watchObservedRunningTime="2026-06-07 16:13:57.250154409 +0000 UTC m=+725.727604092" Jun 07 16:16:52.016896 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:52.016869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:16:52.020390 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:52.020371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:16:53.195025 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.194990 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx"] Jun 07 16:16:53.198657 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.198641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.201007 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.200986 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:16:53.201819 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.201799 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:16:53.201959 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.201853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nddxh\"" Jun 07 16:16:53.201959 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.201861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 07 16:16:53.206972 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.206694 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx"] Jun 07 16:16:53.368241 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.368241 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368247 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxg8z\" (UniqueName: \"kubernetes.io/projected/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kube-api-access-cxg8z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.368491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.368491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.368491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.368491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.368478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469488 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469488 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469698 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxg8z\" (UniqueName: \"kubernetes.io/projected/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kube-api-access-cxg8z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.469991 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.470083 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.469988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.470083 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.470069 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.471822 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.471805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.472001 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.471987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.476984 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.476959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxg8z\" (UniqueName: \"kubernetes.io/projected/473fe25c-bbd1-4b82-aec1-1f9e56fa6804-kube-api-access-cxg8z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx\" (UID: \"473fe25c-bbd1-4b82-aec1-1f9e56fa6804\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.510933 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.510900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:16:53.650663 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.650632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx"] Jun 07 16:16:53.651860 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:16:53.651831 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473fe25c_bbd1_4b82_aec1_1f9e56fa6804.slice/crio-95752c37bdde98ceabcc453786fe2ad93ea6874312ecc81297f8bfbcfdf81acc WatchSource:0}: Error finding container 95752c37bdde98ceabcc453786fe2ad93ea6874312ecc81297f8bfbcfdf81acc: Status 404 returned error can't find the container with id 95752c37bdde98ceabcc453786fe2ad93ea6874312ecc81297f8bfbcfdf81acc Jun 07 16:16:53.653694 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:53.653675 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:16:54.236072 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:54.236025 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" event={"ID":"473fe25c-bbd1-4b82-aec1-1f9e56fa6804","Type":"ContainerStarted","Data":"95752c37bdde98ceabcc453786fe2ad93ea6874312ecc81297f8bfbcfdf81acc"} Jun 07 16:16:57.260508 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:57.260474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" event={"ID":"473fe25c-bbd1-4b82-aec1-1f9e56fa6804","Type":"ContainerStarted","Data":"e1b2e1b85d5a38d626f35f9969c40c5e67d6e81bfb08a10b2801eeaf6081bf71"} Jun 07 16:16:59.272838 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:59.272805 2561 generic.go:356] "Generic (PLEG): container finished" podID="473fe25c-bbd1-4b82-aec1-1f9e56fa6804" containerID="e1b2e1b85d5a38d626f35f9969c40c5e67d6e81bfb08a10b2801eeaf6081bf71" exitCode=0 Jun 07 16:16:59.273228 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:16:59.272880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" event={"ID":"473fe25c-bbd1-4b82-aec1-1f9e56fa6804","Type":"ContainerDied","Data":"e1b2e1b85d5a38d626f35f9969c40c5e67d6e81bfb08a10b2801eeaf6081bf71"} Jun 07 16:17:01.287232 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:01.287194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" event={"ID":"473fe25c-bbd1-4b82-aec1-1f9e56fa6804","Type":"ContainerStarted","Data":"06828104c5f18efc2bce334766418d62a4524bdeaf5c42f744826a64b0610365"} Jun 07 16:17:01.305823 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:01.305769 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" podStartSLOduration=2.5219690850000003 podStartE2EDuration="8.305731715s" totalImagesPullingTime="4.503448412s" totalInitContainerRuntime="1.280314218s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:16:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:17:01.303810822 +0000 UTC m=+909.781260507" watchObservedRunningTime="2026-06-07 16:17:01.305731715 +0000 UTC m=+909.783181397" Jun 07 16:17:03.511373 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:03.511339 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:17:03.511776 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:03.511430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:17:03.523955 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:03.523928 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:17:04.316439 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:04.316406 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx" Jun 07 16:17:38.089386 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.089339 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp"] Jun 07 16:17:38.092214 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.092193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.094914 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.094893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 07 16:17:38.104296 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.104271 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp"] Jun 07 16:17:38.153645 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mkb\" (UniqueName: \"kubernetes.io/projected/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kube-api-access-82mkb\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.153903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.153903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.153903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.153903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.153903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.153868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255053 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255191 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255191 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255191 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255191 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255332 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mkb\" (UniqueName: \"kubernetes.io/projected/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kube-api-access-82mkb\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255458 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255549 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.255613 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.255597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.257587 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.257562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.257766 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.257730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.262662 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.262643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mkb\" (UniqueName: \"kubernetes.io/projected/1505f08e-2b58-4f64-b2fd-ff2bdd22e317-kube-api-access-82mkb\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-92vzp\" (UID: \"1505f08e-2b58-4f64-b2fd-ff2bdd22e317\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.402253 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.402167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:38.536165 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:38.536136 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp"] Jun 07 16:17:38.537258 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:17:38.537236 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1505f08e_2b58_4f64_b2fd_ff2bdd22e317.slice/crio-bf12835f2b20593edb828c131bdcb68e046fb24e1bb3d9f636adc853b5f2a7d4 WatchSource:0}: Error finding container bf12835f2b20593edb828c131bdcb68e046fb24e1bb3d9f636adc853b5f2a7d4: Status 404 returned error can't find the container with id bf12835f2b20593edb828c131bdcb68e046fb24e1bb3d9f636adc853b5f2a7d4 Jun 07 16:17:39.508957 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:39.508918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" event={"ID":"1505f08e-2b58-4f64-b2fd-ff2bdd22e317","Type":"ContainerStarted","Data":"22d2889ca3941e804c2104da954833386b958c0ad0a988a1a35bfa0bc4bff9a8"} Jun 07 16:17:39.508957 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:39.508960 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" event={"ID":"1505f08e-2b58-4f64-b2fd-ff2bdd22e317","Type":"ContainerStarted","Data":"bf12835f2b20593edb828c131bdcb68e046fb24e1bb3d9f636adc853b5f2a7d4"} Jun 07 16:17:40.516172 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:40.516135 2561 generic.go:356] "Generic (PLEG): container finished" podID="1505f08e-2b58-4f64-b2fd-ff2bdd22e317" containerID="22d2889ca3941e804c2104da954833386b958c0ad0a988a1a35bfa0bc4bff9a8" exitCode=0 Jun 07 16:17:40.516594 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:40.516222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" event={"ID":"1505f08e-2b58-4f64-b2fd-ff2bdd22e317","Type":"ContainerDied","Data":"22d2889ca3941e804c2104da954833386b958c0ad0a988a1a35bfa0bc4bff9a8"} Jun 07 16:17:41.523566 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:41.523518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" event={"ID":"1505f08e-2b58-4f64-b2fd-ff2bdd22e317","Type":"ContainerStarted","Data":"0a5beb350963668b52da98c0a960558cd57104262eb863b956c1d1a8b363d337"} Jun 07 16:17:41.540676 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:41.540622 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" podStartSLOduration=2.084613367 podStartE2EDuration="3.540605572s" totalImagesPullingTime="165.832925ms" totalInitContainerRuntime="1.29015928s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:17:41.539244722 +0000 UTC m=+950.016694405" watchObservedRunningTime="2026-06-07 16:17:41.540605572 +0000 UTC m=+950.018055255" Jun 07 16:17:48.402615 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:48.402582 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:48.403037 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:48.402631 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:48.415252 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:48.415224 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:17:48.575423 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:17:48.575396 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-92vzp" Jun 07 16:21:52.058895 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:21:52.058871 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:21:52.062811 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:21:52.062791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:22:51.144860 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:51.144831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558f5455c4-6pnpl_0e6db1ca-80a6-4b8f-846c-d58197e5e300/nginx/0.log" Jun 07 16:22:51.368227 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:51.368177 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ztbvb_7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9/manager/0.log" Jun 07 16:22:51.483867 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:51.483785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-wtnw4_a22974af-b1ec-45d2-bcb7-5d9393765cda/manager/0.log" Jun 07 16:22:51.703857 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:51.703828 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-28jpf_4915946a-ac49-456a-8ab7-323bf88a7092/server/0.log" Jun 07 16:22:51.817744 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:51.817714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vxzn8_34dd6439-a329-41ed-9ddc-b76a9e6bf602/manager/0.log" Jun 07 16:22:52.162781 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:52.162678 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-szflf_d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3/copy-manifests/0.log" Jun 07 16:22:52.168934 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:52.168911 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-szflf_d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3/manager/0.log" Jun 07 16:22:52.894826 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:52.894795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/util/0.log" Jun 07 16:22:52.900509 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:52.900488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/pull/0.log" Jun 07 16:22:52.906024 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:52.905994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/extract/0.log" Jun 07 16:22:53.020728 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.020701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/util/0.log" Jun 07 16:22:53.026080 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.026059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/pull/0.log" Jun 07 16:22:53.033467 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.033451 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/extract/0.log" Jun 07 16:22:53.136948 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.136923 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/util/0.log" Jun 07 16:22:53.142368 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.142353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/pull/0.log" Jun 07 16:22:53.147809 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.147745 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/extract/0.log" Jun 07 16:22:53.258815 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.258791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/util/0.log" Jun 07 16:22:53.264580 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.264560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/pull/0.log" Jun 07 16:22:53.270113 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.270097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/extract/0.log" Jun 07 16:22:53.493274 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:53.493248 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b7pgg_818fa32f-9eb5-4cee-840e-9338d9562a76/manager/0.log" Jun 07 16:22:54.636031 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:54.636001 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dl5ds_519a8d70-033c-4d2a-af79-b89ffda973d8/discovery/0.log" Jun 07 16:22:54.736361 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:54.736337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-r8l88_74a3341f-901e-4f87-98a6-068341e0a39b/kube-auth-proxy/0.log" Jun 07 16:22:55.276365 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:55.276336 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c47c7fcf-9wjrs_2ecc9de3-f034-4971-b936-8adc69379c14/router/0.log" Jun 07 16:22:55.818135 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:55.818107 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx_473fe25c-bbd1-4b82-aec1-1f9e56fa6804/storage-initializer/0.log" Jun 07 16:22:55.824929 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:55.824899 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5drwx_473fe25c-bbd1-4b82-aec1-1f9e56fa6804/main/0.log" Jun 07 16:22:56.161227 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:56.161145 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-92vzp_1505f08e-2b58-4f64-b2fd-ff2bdd22e317/storage-initializer/0.log" Jun 07 16:22:56.167630 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:22:56.167608 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-92vzp_1505f08e-2b58-4f64-b2fd-ff2bdd22e317/main/0.log" Jun 07 16:23:03.393870 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:03.393841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gqvzf_ff626d0a-5d3e-4883-a4bd-f5f660aed8b8/global-pull-secret-syncer/0.log" Jun 07 16:23:03.548726 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:03.548697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g7pnr_bff93d1f-02ad-48d7-ad1a-97aa53e5d962/konnectivity-agent/0.log" Jun 07 16:23:03.636387 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:03.636359 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-225.ec2.internal_9c7f5e21ad719a7119be8c23253c6d35/haproxy/0.log" Jun 07 16:23:07.872438 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:07.872402 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-scpjz_aa7d2045-1df4-40a2-afd0-507cededc559/sail-operator/0.log" Jun 07 16:23:08.007201 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.007174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/extract/0.log" Jun 07 16:23:08.028655 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.028635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/util/0.log" Jun 07 16:23:08.055946 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.055923 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759thd9k_2f3a85e0-0bc7-4937-b826-52aaaaccceaf/pull/0.log" Jun 07 16:23:08.162568 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.162502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/extract/0.log" Jun 07 16:23:08.181649 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.181627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/util/0.log" Jun 07 16:23:08.199903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.199884 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t6r9c_3415c3a0-ba9a-4ecb-a5fa-e5ee5e4b22f3/pull/0.log" Jun 07 16:23:08.222879 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.222860 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/extract/0.log" Jun 07 16:23:08.240554 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.240528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/util/0.log" Jun 07 16:23:08.263425 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.263407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vmkq4_50da1fed-d050-458d-8395-86156b4ade0a/pull/0.log" Jun 07 16:23:08.288171 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.288151 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/extract/0.log" Jun 07 16:23:08.316959 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.316943 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/util/0.log" Jun 07 16:23:08.335536 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.335517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19vjhh_cf7afc8c-21ac-4048-9a7e-74ab99ff038c/pull/0.log" Jun 07 16:23:08.478460 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:08.478376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b7pgg_818fa32f-9eb5-4cee-840e-9338d9562a76/manager/0.log" Jun 07 16:23:10.313234 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.313204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/alertmanager/0.log" Jun 07 16:23:10.334834 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.334815 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/config-reloader/0.log" Jun 07 16:23:10.354563 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.354532 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/kube-rbac-proxy-web/0.log" Jun 07 16:23:10.377720 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.377699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/kube-rbac-proxy/0.log" Jun 07 16:23:10.396797 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.396776 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/kube-rbac-proxy-metric/0.log" Jun 07 16:23:10.417679 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.417661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/prom-label-proxy/0.log" Jun 07 16:23:10.440581 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.440560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2b34a3e-bf4b-4a49-a07d-45f778d79a37/init-config-reloader/0.log" Jun 07 16:23:10.467801 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.467780 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-whfzx_aa688ab4-904b-46a4-b760-d0c23a520618/cluster-monitoring-operator/0.log" Jun 07 16:23:10.615670 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.615594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kb6z_b4d8a383-af82-4d6c-a49e-a99bb88f3256/node-exporter/0.log" Jun 07 16:23:10.634050 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.634026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kb6z_b4d8a383-af82-4d6c-a49e-a99bb88f3256/kube-rbac-proxy/0.log" Jun 07 16:23:10.652206 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:10.652180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kb6z_b4d8a383-af82-4d6c-a49e-a99bb88f3256/init-textfile/0.log" Jun 07 16:23:11.065113 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:11.065088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ww86n_ed7b9069-7643-409d-a57d-affcc1cd2cc3/prometheus-operator/0.log" Jun 07 16:23:11.086336 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:11.086309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-ww86n_ed7b9069-7643-409d-a57d-affcc1cd2cc3/kube-rbac-proxy/0.log" Jun 07 16:23:11.111899 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:11.111874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-28l7s_a52a8d17-9285-41e0-9d34-53aecb55afdc/prometheus-operator-admission-webhook/0.log" Jun 07 16:23:12.893789 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:12.893743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-s76ml_463232c7-9d2a-4a33-8a33-a368f5a3d668/networking-console-plugin/0.log" Jun 07 16:23:14.114903 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.114875 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-xmn48_79ca6dbc-c034-4025-b4f0-fb64f7436fff/download-server/0.log" Jun 07 16:23:14.760888 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.760856 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-fslrf_5a74ede8-17ad-40f4-8415-9302f45cc25f/volume-data-source-validator/0.log" Jun 07 16:23:14.901622 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.901593 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k"] Jun 07 16:23:14.905192 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.905174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:14.907574 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.907554 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"kube-root-ca.crt\"" Jun 07 16:23:14.908494 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.908458 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"openshift-service-ca.crt\"" Jun 07 16:23:14.908595 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.908463 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59tjk\"/\"default-dockercfg-mcg5b\"" Jun 07 16:23:14.912193 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:14.912170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k"] Jun 07 16:23:15.024460 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.024382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895qk\" (UniqueName: \"kubernetes.io/projected/98089457-0eec-4764-a0b4-2622e57ba0c8-kube-api-access-895qk\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.024460 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.024424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-lib-modules\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.024703 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.024475 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-sys\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.024703 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.024516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-proc\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.024703 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.024542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-podres\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125185 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-sys\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-proc\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-podres\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125265 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-sys\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-895qk\" (UniqueName: \"kubernetes.io/projected/98089457-0eec-4764-a0b4-2622e57ba0c8-kube-api-access-895qk\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-proc\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-podres\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125612 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-lib-modules\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.125880 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.125630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98089457-0eec-4764-a0b4-2622e57ba0c8-lib-modules\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.132997 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.132976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-895qk\" (UniqueName: \"kubernetes.io/projected/98089457-0eec-4764-a0b4-2622e57ba0c8-kube-api-access-895qk\") pod \"perf-node-gather-daemonset-fwd6k\" (UID: \"98089457-0eec-4764-a0b4-2622e57ba0c8\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.215986 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.215960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.346126 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.346102 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k"] Jun 07 16:23:15.349568 ip-10-0-142-225 kubenswrapper[2561]: W0607 16:23:15.349542 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98089457_0eec_4764_a0b4_2622e57ba0c8.slice/crio-f34f152af544c4c25eedaf87fdbda44031684547e6dc6cd6aa40be925941b1b1 WatchSource:0}: Error finding container f34f152af544c4c25eedaf87fdbda44031684547e6dc6cd6aa40be925941b1b1: Status 404 returned error can't find the container with id f34f152af544c4c25eedaf87fdbda44031684547e6dc6cd6aa40be925941b1b1 Jun 07 16:23:15.474827 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.474792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" event={"ID":"98089457-0eec-4764-a0b4-2622e57ba0c8","Type":"ContainerStarted","Data":"364ea9cd92441a8940e5af0e20d7be5a9ca986bb7f5233391e6d872200f3e089"} Jun 07 16:23:15.474951 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.474882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" event={"ID":"98089457-0eec-4764-a0b4-2622e57ba0c8","Type":"ContainerStarted","Data":"f34f152af544c4c25eedaf87fdbda44031684547e6dc6cd6aa40be925941b1b1"} Jun 07 16:23:15.474951 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.474915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:15.491179 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:15.491130 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" podStartSLOduration=1.491116565 podStartE2EDuration="1.491116565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:23:15.487964849 +0000 UTC m=+1283.965414544" watchObservedRunningTime="2026-06-07 16:23:15.491116565 +0000 UTC m=+1283.968566248" Jun 07 16:23:16.094322 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.094295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7s9s_b8e350eb-133a-4a0b-88e9-d044d171136e/dns/0.log" Jun 07 16:23:16.114651 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.114622 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7s9s_b8e350eb-133a-4a0b-88e9-d044d171136e/kube-rbac-proxy/0.log" Jun 07 16:23:16.189149 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.189123 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztwzc_8d71f77c-0e9d-4536-905f-d6a121d02940/dns-node-resolver/0.log" Jun 07 16:23:16.678877 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.678845 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bdc5b94d6-fgmtl_83ddd003-b1b5-457e-aef4-c79539873f6a/registry/0.log" Jun 07 16:23:16.682037 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.682013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bdc5b94d6-fgmtl_83ddd003-b1b5-457e-aef4-c79539873f6a/registry/1.log" Jun 07 16:23:16.742287 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:16.742258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xghb2_a70cfa9b-a6e0-437f-8ab7-5799ffc61281/node-ca/0.log" Jun 07 16:23:17.691762 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:17.691732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dl5ds_519a8d70-033c-4d2a-af79-b89ffda973d8/discovery/0.log" Jun 07 16:23:17.708862 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:17.708835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-r8l88_74a3341f-901e-4f87-98a6-068341e0a39b/kube-auth-proxy/0.log" Jun 07 16:23:17.854307 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:17.854279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c47c7fcf-9wjrs_2ecc9de3-f034-4971-b936-8adc69379c14/router/0.log" Jun 07 16:23:18.443070 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:18.443039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6nnxv_d3f89795-9eed-4f27-9f14-f200db67859f/serve-healthcheck-canary/0.log" Jun 07 16:23:18.973120 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:18.973093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-9b4rp_11a9ee97-bde3-418a-8b63-a19aacd8c4ec/insights-operator/1.log" Jun 07 16:23:18.978215 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:18.978193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-9b4rp_11a9ee97-bde3-418a-8b63-a19aacd8c4ec/insights-operator/0.log" Jun 07 16:23:19.129069 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:19.129044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v97mg_2fa7eb91-32e7-48e7-83a4-07ffe8855365/kube-rbac-proxy/0.log" Jun 07 16:23:19.147482 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:19.147445 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v97mg_2fa7eb91-32e7-48e7-83a4-07ffe8855365/exporter/0.log" Jun 07 16:23:19.165957 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:19.165931 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v97mg_2fa7eb91-32e7-48e7-83a4-07ffe8855365/extractor/0.log" Jun 07 16:23:21.317357 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.317326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558f5455c4-6pnpl_0e6db1ca-80a6-4b8f-846c-d58197e5e300/nginx/0.log" Jun 07 16:23:21.359748 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.359716 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ztbvb_7f0aee69-1c11-47cc-81c3-f0b54ed6d8e9/manager/0.log" Jun 07 16:23:21.400839 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.400810 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-wtnw4_a22974af-b1ec-45d2-bcb7-5d9393765cda/manager/0.log" Jun 07 16:23:21.443375 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.443348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-28jpf_4915946a-ac49-456a-8ab7-323bf88a7092/server/0.log" Jun 07 16:23:21.488237 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.488212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vxzn8_34dd6439-a329-41ed-9ddc-b76a9e6bf602/manager/0.log" Jun 07 16:23:21.491315 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.491294 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-fwd6k" Jun 07 16:23:21.643234 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.643157 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-szflf_d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3/manager/0.log" Jun 07 16:23:21.661068 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:21.661044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-szflf_d9c8ce2b-cbce-4d03-85bb-922d8f24e8c3/copy-manifests/0.log" Jun 07 16:23:29.115721 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:29.115687 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dl5ds_519a8d70-033c-4d2a-af79-b89ffda973d8/discovery/0.log" Jun 07 16:23:29.126805 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:29.126781 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-r8l88_74a3341f-901e-4f87-98a6-068341e0a39b/kube-auth-proxy/0.log" Jun 07 16:23:29.150035 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:29.149999 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jxhv2_b8c93f94-63c5-4d8a-9b70-48358a2781ad/kube-storage-version-migrator-operator/1.log" Jun 07 16:23:29.150978 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:29.150962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jxhv2_b8c93f94-63c5-4d8a-9b70-48358a2781ad/kube-storage-version-migrator-operator/0.log" Jun 07 16:23:29.245576 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:29.245546 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c47c7fcf-9wjrs_2ecc9de3-f034-4971-b936-8adc69379c14/router/0.log" Jun 07 16:23:30.382327 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.382299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dl5ds_519a8d70-033c-4d2a-af79-b89ffda973d8/discovery/0.log" Jun 07 16:23:30.393370 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.393347 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-r8l88_74a3341f-901e-4f87-98a6-068341e0a39b/kube-auth-proxy/0.log" Jun 07 16:23:30.503367 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.503341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c47c7fcf-9wjrs_2ecc9de3-f034-4971-b936-8adc69379c14/router/0.log" Jun 07 16:23:30.708021 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.707925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/kube-multus-additional-cni-plugins/0.log" Jun 07 16:23:30.730289 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.730264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/egress-router-binary-copy/0.log" Jun 07 16:23:30.750084 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.750061 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/cni-plugins/0.log" Jun 07 16:23:30.772101 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.772075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/bond-cni-plugin/0.log" Jun 07 16:23:30.795176 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.795152 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/routeoverride-cni/0.log" Jun 07 16:23:30.817447 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.817424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/whereabouts-cni-bincopy/0.log" Jun 07 16:23:30.837163 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.837133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9f5v_ace2547a-7d1a-426f-85c3-88b3a3129a2c/whereabouts-cni/0.log" Jun 07 16:23:30.899572 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.899548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wwj4k_98de7dbe-a7b6-4c0f-8d5f-c051df5905a5/kube-multus/0.log" Jun 07 16:23:30.971105 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.971039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p4cg9_8fdfd12b-1bd4-4e73-9733-b442cc7ae310/network-metrics-daemon/0.log" Jun 07 16:23:30.988813 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:30.988785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p4cg9_8fdfd12b-1bd4-4e73-9733-b442cc7ae310/kube-rbac-proxy/0.log" Jun 07 16:23:32.152356 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.152318 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dl5ds_519a8d70-033c-4d2a-af79-b89ffda973d8/discovery/0.log" Jun 07 16:23:32.164331 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.164311 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-r8l88_74a3341f-901e-4f87-98a6-068341e0a39b/kube-auth-proxy/0.log" Jun 07 16:23:32.172574 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.172554 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-controller/0.log" Jun 07 16:23:32.189253 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.189229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/0.log" Jun 07 16:23:32.189384 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.189289 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovn-acl-logging/1.log" Jun 07 16:23:32.209004 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.208983 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/kube-rbac-proxy-node/0.log" Jun 07 16:23:32.227872 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.227844 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/kube-rbac-proxy-ovn-metrics/0.log" Jun 07 16:23:32.242432 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.242416 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/northd/0.log" Jun 07 16:23:32.261263 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.261202 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/nbdb/0.log" Jun 07 16:23:32.266491 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.266461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c47c7fcf-9wjrs_2ecc9de3-f034-4971-b936-8adc69379c14/router/0.log" Jun 07 16:23:32.287882 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.287845 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/sbdb/0.log" Jun 07 16:23:32.336704 ip-10-0-142-225 kubenswrapper[2561]: I0607 16:23:32.336683 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sxnjj_7f9efe49-aec9-436c-a867-662fc831ee21/ovnkube-controller/0.log"