Jun 03 19:29:16.467241 ip-10-0-136-174 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:29:16.931737 ip-10-0-136-174 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:16.931737 ip-10-0-136-174 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:29:16.931737 ip-10-0-136-174 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:16.931737 ip-10-0-136-174 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:29:16.931737 ip-10-0-136-174 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:16.934522 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.934431 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:29:16.940140 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940123 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.940140 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940140 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940143 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940147 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940150 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940153 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940156 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940159 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940162 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940165 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940169 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940173 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940177 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940180 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940185 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940189 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940192 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940195 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940198 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940201 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.940207 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940204 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940206 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940210 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940213 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940215 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940218 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940221 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940224 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940226 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940229 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940232 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940234 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940237 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940240 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940242 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940245 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940247 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940250 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940252 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940255 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.940664 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940258 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940260 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940263 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940266 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940268 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940271 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940274 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940277 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940280 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940283 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940285 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940288 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940291 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940294 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940297 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940300 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940303 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940305 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940308 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940310 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.941160 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940313 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940316 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940318 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940321 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940323 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940326 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940328 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940331 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940333 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940336 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940338 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940342 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940345 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940348 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940350 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940353 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940356 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940358 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940361 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.941690 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940364 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940367 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940370 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940372 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940375 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940377 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940380 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940383 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940386 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940388 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940393 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940397 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940400 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940403 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940406 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940409 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940412 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940415 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.940417 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941155 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.942174 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941162 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941166 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941169 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941172 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941174 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941178 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941180 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941183 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941186 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941188 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941191 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941194 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941197 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941199 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941204 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941207 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941210 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941213 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941216 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.942693 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941220 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941223 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941225 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941228 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941231 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941234 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941236 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941239 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941242 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941244 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941247 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941249 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941252 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941254 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941257 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941260 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941263 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941265 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941268 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941271 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.943263 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941274 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941276 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941279 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941281 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941284 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941287 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941290 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941293 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941295 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941298 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941300 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941303 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941306 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941308 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941311 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941313 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941318 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941321 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941324 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.943804 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941327 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941330 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941334 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941337 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941340 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941343 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941346 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941348 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941351 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941354 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941356 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941359 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941362 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941366 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941369 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941371 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941374 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941376 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941382 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941385 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.944301 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941387 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941390 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941393 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941395 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941398 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941401 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941403 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941406 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941408 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941411 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941414 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941416 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941419 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941421 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941424 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941427 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941431 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941434 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941437 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941807 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.944787 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941811 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941815 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941818 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941821 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941825 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941829 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941832 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941835 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941838 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941841 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941844 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941847 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941865 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941868 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941872 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941876 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941879 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941882 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941885 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.945302 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941887 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941890 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941892 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941895 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941898 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941900 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941903 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941906 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941908 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941911 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941915 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941918 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941921 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941924 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941927 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941930 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941932 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941936 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941939 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.945762 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941943 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941946 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941950 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941952 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941955 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941958 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941961 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941963 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941966 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941969 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941971 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941974 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941977 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941980 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941982 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941985 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941988 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941991 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941993 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941995 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.946235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.941998 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942000 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942003 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942005 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942008 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942010 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942013 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942017 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942020 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942022 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942025 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942027 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942030 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942034 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942037 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942039 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942042 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942044 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942047 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942049 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.946723 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942052 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942055 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942057 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942060 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942062 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942065 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942068 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942070 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942073 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942075 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942078 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942080 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942083 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942085 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942088 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942090 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942093 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942095 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942098 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942165 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:29:16.947235 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942172 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942179 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942185 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942191 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942196 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942202 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942210 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942214 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942217 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942220 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942223 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942227 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942229 2558 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942232 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942235 2558 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942238 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942241 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942245 2558 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942248 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942251 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942254 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942259 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942263 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:29:16.947730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942266 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942269 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942273 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942276 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942279 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942281 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942285 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942287 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942293 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942296 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942299 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942302 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942305 2558 flags.go:64] FLAG: --enable-server="true" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942308 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942313 2558 flags.go:64] FLAG: --event-burst="100" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942316 2558 flags.go:64] FLAG: --event-qps="50" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942320 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942324 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942327 2558 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942330 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942333 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942336 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942339 2558 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942342 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942345 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:29:16.948317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942348 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942351 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942354 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942356 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942359 2558 flags.go:64] FLAG: --feature-gates="" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942365 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942368 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942371 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942374 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942377 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942380 2558 flags.go:64] FLAG: --help="false" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942405 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-136-174.ec2.internal" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942409 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942412 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942415 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942420 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942424 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942427 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942430 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942433 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942436 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942439 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942442 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942445 2558 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:29:16.948927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942448 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942451 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942454 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942457 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942460 2558 flags.go:64] FLAG: --lock-file="" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942463 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942466 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942469 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942474 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942477 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942480 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942483 2558 flags.go:64] FLAG: --logging-format="text" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942486 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942490 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942493 2558 flags.go:64] FLAG: --manifest-url="" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942496 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942501 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942504 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942508 2558 flags.go:64] FLAG: --max-pods="110" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942511 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942514 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942517 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942520 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942524 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942527 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:29:16.949578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942531 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942538 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942541 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942544 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942547 2558 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942550 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942555 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942558 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942562 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942565 2558 flags.go:64] FLAG: --port="10250" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942568 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942571 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb9f9d1db3f743e9" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942574 2558 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942577 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942580 2558 flags.go:64] FLAG: --register-node="true" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942583 2558 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942587 2558 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942590 2558 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942594 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942596 2558 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942600 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942604 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942607 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942610 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942613 2558 flags.go:64] FLAG: --runonce="false" Jun 03 19:29:16.950217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942616 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942620 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942623 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942625 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942628 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942632 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942635 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942638 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942642 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942645 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942647 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942650 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942654 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942657 2558 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942660 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942665 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942668 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942671 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942675 2558 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942678 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942681 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942684 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942687 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942690 2558 flags.go:64] FLAG: --v="2" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942694 2558 flags.go:64] FLAG: --version="false" Jun 03 19:29:16.951270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942698 2558 flags.go:64] FLAG: --vmodule="" Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942703 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.942706 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942823 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942826 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942830 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942833 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942836 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942838 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942841 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942844 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942846 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942864 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942867 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942870 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942874 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942878 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942881 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942884 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942887 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.952358 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942890 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942892 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942895 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942898 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942901 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942904 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942908 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942911 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942914 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942917 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942921 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942923 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942927 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942929 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942932 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942938 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942941 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942944 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942947 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.953372 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942950 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942953 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942956 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942958 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942961 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942965 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942967 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942970 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942973 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942975 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942978 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942981 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942983 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942986 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942989 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942992 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942994 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.942998 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943002 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.954221 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943005 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943008 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943011 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943014 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943016 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943019 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943022 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943024 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943027 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943031 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943034 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943036 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943039 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943042 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943044 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943047 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943049 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943052 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943056 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943059 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.954928 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943061 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943064 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943067 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943069 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943072 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943074 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943077 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943080 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943083 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943085 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943088 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943090 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943094 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943097 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943099 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943102 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943104 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943107 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943109 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943112 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.955530 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943114 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943118 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.943121 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.943788 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.952970 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.952990 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.953018 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.953027 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953123 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953131 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953136 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953144 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953150 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953156 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953161 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.956379 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953165 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953170 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953177 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953182 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953187 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953192 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953197 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953202 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953206 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953211 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953215 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953220 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953224 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953228 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953233 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953237 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953242 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953246 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953251 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.957073 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953255 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953260 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953264 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953276 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953281 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953285 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953289 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953293 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953298 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953302 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953307 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953311 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953316 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953320 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953324 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953328 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953333 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953337 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953341 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953346 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.957544 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953350 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953355 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953359 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953363 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953367 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953371 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953375 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953379 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953383 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953387 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953391 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953396 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953400 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953407 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953414 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953419 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953434 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953438 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953443 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953447 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.958204 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953451 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953455 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953460 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953464 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953468 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953473 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953477 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953482 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953486 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953490 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953494 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953498 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953502 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953506 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953510 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953515 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953519 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953523 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953527 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.958719 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953532 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953536 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953540 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953545 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953549 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953553 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953558 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953562 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953566 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953570 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953583 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953587 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953591 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.953600 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953826 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:16.959234 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953835 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953840 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953845 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953867 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953872 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953876 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953880 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953884 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953888 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953892 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953896 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953901 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953905 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953909 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953914 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953918 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953923 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953930 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953935 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953939 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:16.959657 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953944 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953948 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953952 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953956 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953961 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953965 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953969 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953973 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953985 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953992 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.953998 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954003 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954008 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954013 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954018 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954022 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954026 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954030 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954035 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:16.960182 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954039 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954043 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954047 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954051 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954055 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954060 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954064 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954068 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954073 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954077 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954081 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954086 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954090 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954094 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954098 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954103 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954107 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954111 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954115 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954120 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:16.960707 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954124 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954128 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954140 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954147 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954153 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954157 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954162 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954167 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954172 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954176 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954181 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954185 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954190 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954195 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954199 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954204 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954208 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954213 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954217 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:16.961258 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954221 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954225 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954229 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954234 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954238 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954242 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954246 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954250 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954255 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954260 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954264 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954268 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954272 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954277 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954281 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954285 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954298 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954303 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:16.961725 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:16.954307 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.954315 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.954528 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.957834 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.959530 2558 server.go:1019] "Starting client certificate rotation" Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.959635 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:29:16.962358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.959666 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:29:16.965119 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.965087 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:29:16.966821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.966799 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:29:16.978727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.978709 2558 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:29:16.982472 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.982457 2558 log.go:25] "Validated CRI v1 image API" Jun 03 19:29:16.983295 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.983280 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:29:16.989500 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.989480 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:29:16.989614 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.989596 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ec38a92-d748-4415-bd83-a1fd42e01050:/dev/nvme0n1p3 e0f840f1-17c9-4228-b49e-c60914b6add4:/dev/nvme0n1p4] Jun 03 19:29:16.989658 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.989618 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:29:16.994978 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.994866 2558 manager.go:216] Machine: {Timestamp:2026-06-03 19:29:16.993392155 +0000 UTC m=+0.386917054 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117363 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f50bf25f383cfd3c10b6011335f5 SystemUUID:ec20f50b-f25f-383c-fd3c-10b6011335f5 BootID:59bd9293-b90a-4d0f-9764-78e110ca9a8b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:c9:70:34:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:c9:70:34:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:af:2d:c9:0f:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:29:16.994978 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.994975 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:29:16.995099 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.995055 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:29:16.998151 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.998129 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:29:16.998294 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.998155 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:29:16.999028 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.999017 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:29:16.999070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.999031 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:29:16.999070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.999040 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:29:16.999070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:16.999055 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:29:17.000356 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.000345 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:29:17.004733 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.004721 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:29:17.005048 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005037 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:29:17.005082 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005073 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:29:17.005118 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005097 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:29:17.005118 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005111 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:29:17.005172 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005126 2558 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:29:17.005172 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005136 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:29:17.005595 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005584 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:29:17.005640 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.005602 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:29:17.008107 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.008092 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:29:17.010625 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.010611 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:29:17.010678 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.010643 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:29:17.012249 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012237 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:29:17.012290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012254 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:29:17.012290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012260 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:29:17.012290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012266 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:29:17.012290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012278 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:29:17.012290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012286 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012297 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012304 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012314 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012320 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012328 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:29:17.012424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.012334 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:29:17.013805 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.013796 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:29:17.013805 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.013805 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:29:17.017861 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.017818 2558 server.go:1268] "Started kubelet" Jun 03 19:29:17.017959 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.017835 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:29:17.017959 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.017893 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:29:17.018054 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.017969 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:29:17.018987 ip-10-0-136-174 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:29:17.019610 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.019069 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:29:17.019787 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.019757 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:29:17.019901 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.019757 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:29:17.020333 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.020305 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:29:17.020712 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.020699 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:29:17.027274 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.027253 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:29:17.028330 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.027170 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18b5a8eb7a4f365e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-06-03 19:29:17.017691742 +0000 UTC m=+0.411216642,LastTimestamp:2026-06-03 19:29:17.017691742 +0000 UTC m=+0.411216642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jun 03 19:29:17.033094 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.033075 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:29:17.033176 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.033078 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:29:17.033226 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.033202 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.033950 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.033933 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:29:17.033950 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.033951 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:29:17.034097 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.033933 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:29:17.034097 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.034059 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:29:17.034097 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.034067 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:29:17.035181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035159 2558 factory.go:153] Registering CRI-O factory Jun 03 19:29:17.035181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035180 2558 factory.go:223] Registration of the crio container factory successfully Jun 03 19:29:17.035284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035233 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:29:17.035284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035243 2558 factory.go:55] Registering systemd factory Jun 03 19:29:17.035284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035251 2558 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:29:17.035284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035284 2558 factory.go:103] Registering Raw factory Jun 03 19:29:17.035505 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035302 2558 manager.go:1196] Started watching for new ooms in manager Jun 03 19:29:17.036086 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.035753 2558 manager.go:349] Starting recovery of all containers Jun 03 19:29:17.041898 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.041733 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:29:17.044551 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.044522 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:29:17.044673 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.044638 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:29:17.045986 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.045963 2558 manager.go:354] Recovery completed Jun 03 19:29:17.050817 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.050805 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.052666 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.052647 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.052745 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.052682 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.052745 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.052698 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.053325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.053312 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:29:17.053325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.053324 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:29:17.053434 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.053340 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:29:17.053434 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.053313 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.054075 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.054057 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.054151 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.054094 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.054151 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.054110 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.055670 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.055658 2558 policy_none.go:49] "None policy: Start" Jun 03 19:29:17.055670 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.055672 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:29:17.055759 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.055683 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:29:17.056342 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.056328 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9l77t" Jun 03 19:29:17.057380 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.057369 2558 policy_none.go:47] "Start" Jun 03 19:29:17.062516 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.062490 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9l77t" Jun 03 19:29:17.063985 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.063601 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18b5a8eb7c64dadf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-06-03 19:29:17.052664543 +0000 UTC m=+0.446189443,LastTimestamp:2026-06-03 19:29:17.052664543 +0000 UTC m=+0.446189443,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jun 03 19:29:17.065939 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.065883 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18b5a8eb7c65393a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-174.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-06-03 19:29:17.052688698 +0000 UTC m=+0.446213599,LastTimestamp:2026-06-03 19:29:17.052688698 +0000 UTC m=+0.446213599,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jun 03 19:29:17.094491 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094461 2558 manager.go:337] "Starting Device Plugin manager" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.094507 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094517 2558 server.go:87] "Starting device plugin registration server" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094796 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094809 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094899 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094970 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.094977 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.096072 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.096113 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.102885 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.102922 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.102941 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.102972 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:29:17.115323 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.105237 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:17.195551 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.195464 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.196557 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.196533 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.196692 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.196574 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.196692 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.196587 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.196692 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.196620 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.203477 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.203459 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"] Jun 03 19:29:17.203542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.203522 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.204303 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.204288 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.204374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.204314 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.204374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.204323 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.204626 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.204612 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.204660 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.204634 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-174.ec2.internal\": node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.206677 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.206665 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.206800 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.206784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.206876 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.206821 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.207475 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207461 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.207541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207486 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.207541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207495 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.207541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207500 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.207541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207517 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.207541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.207529 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.209644 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.209630 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.209712 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.209654 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:17.210376 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.210362 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:17.210450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.210387 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:17.210450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.210401 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:17.232384 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.232360 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.235173 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.235155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.235265 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.235181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.235265 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.235201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03c065fca101d5f39c7adc677b1cb157-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"03c065fca101d5f39c7adc677b1cb157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.237117 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.237100 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.259612 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.259593 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.335698 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.335698 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.335967 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03c065fca101d5f39c7adc677b1cb157-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"03c065fca101d5f39c7adc677b1cb157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.335967 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.335967 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335788 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03c065fca101d5f39c7adc677b1cb157-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"03c065fca101d5f39c7adc677b1cb157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.335967 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.335791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a83ba7fe97524b277084ee29b816f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"63a83ba7fe97524b277084ee29b816f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.360259 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.360222 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.461371 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.461291 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.536181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.536154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.543861 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.543830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:17.561538 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.561516 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.662289 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.662246 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.762976 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.762892 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.853181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.853149 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:17.863283 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.863258 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:17.958931 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.958903 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:29:17.959568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.959050 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:29:17.959568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:17.959082 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:29:17.964079 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:17.964057 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:18.033648 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:18.033616 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a83ba7fe97524b277084ee29b816f7.slice/crio-fa6ff68e24fd5af3f3334e084d9efb647641c3bdd6fb418d4235a00a86a713b6 WatchSource:0}: Error finding container fa6ff68e24fd5af3f3334e084d9efb647641c3bdd6fb418d4235a00a86a713b6: Status 404 returned error can't find the container with id fa6ff68e24fd5af3f3334e084d9efb647641c3bdd6fb418d4235a00a86a713b6 Jun 03 19:29:18.034330 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:18.034296 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c065fca101d5f39c7adc677b1cb157.slice/crio-d804fbd76edf8441a7fa139430c7f42afe6dbb7abe8b563c88240f4529c8186f WatchSource:0}: Error finding container d804fbd76edf8441a7fa139430c7f42afe6dbb7abe8b563c88240f4529c8186f: Status 404 returned error can't find the container with id d804fbd76edf8441a7fa139430c7f42afe6dbb7abe8b563c88240f4529c8186f Jun 03 19:29:18.040161 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.040147 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:29:18.064300 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.064277 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:18.066433 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.066414 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:24:17 +0000 UTC" deadline="2028-01-01 15:40:30.347684102 +0000 UTC" Jun 03 19:29:18.066488 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.066433 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13844h11m12.281253445s" Jun 03 19:29:18.073578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.073556 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:18.074754 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.074739 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:18.074861 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.074772 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:18.074861 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.074786 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:18.106245 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.106205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"03c065fca101d5f39c7adc677b1cb157","Type":"ContainerStarted","Data":"d804fbd76edf8441a7fa139430c7f42afe6dbb7abe8b563c88240f4529c8186f"} Jun 03 19:29:18.107130 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.107111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"63a83ba7fe97524b277084ee29b816f7","Type":"ContainerStarted","Data":"fa6ff68e24fd5af3f3334e084d9efb647641c3bdd6fb418d4235a00a86a713b6"} Jun 03 19:29:18.145813 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.145545 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:18.164986 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.164963 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:18.265467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.265434 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jun 03 19:29:18.348572 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.348502 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:18.433483 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.433441 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jun 03 19:29:18.448668 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.448627 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:29:18.450192 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.449755 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:18.459530 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:18.459502 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:29:18.866435 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.866383 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8: Digest did not match, expected sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf58a5bde777f1d7261b6f09eb43ff777646642310776b8134fd8d1e1d8d771b" Jun 03 19:29:18.866613 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.866530 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container haproxy start failed in pod kube-apiserver-proxy-ip-10-0-136-174.ec2.internal_kube-system(03c065fca101d5f39c7adc677b1cb157): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8: Digest did not match, expected sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 03 19:29:18.866690 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:18.866631 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8: Digest did not match, expected sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podUID="03c065fca101d5f39c7adc677b1cb157" Jun 03 19:29:19.007236 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.007157 2558 apiserver.go:52] "Watching apiserver" Jun 03 19:29:19.014673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.014649 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:29:19.017170 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.017145 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-x2z9d","kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal","openshift-network-diagnostics/network-check-target-6hqpg","openshift-network-operator/iptables-alerter-ld5zx","openshift-ovn-kubernetes/ovnkube-node-tqb5x","kube-system/global-pull-secret-syncer-zm2zr","kube-system/konnectivity-agent-jvpc6","openshift-cluster-node-tuning-operator/tuned-qm868","openshift-dns/node-resolver-bptc6","openshift-image-registry/node-ca-9zshw","openshift-multus/multus-additional-cni-plugins-r7tkx","openshift-multus/multus-s9lwm"] Jun 03 19:29:19.019945 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.019924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.022091 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.022070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.022610 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.022582 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.022719 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.022582 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.022719 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.022659 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvxl9\"" Jun 03 19:29:19.024029 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.023994 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:29:19.024233 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.024413 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024391 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:29:19.024413 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n5dst\"" Jun 03 19:29:19.024651 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024626 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.024651 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024642 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:29:19.024777 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.024634 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.026090 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.026071 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:29:19.026460 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.026299 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbcbc\"" Jun 03 19:29:19.026460 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.026304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.026460 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.026334 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.026460 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.026397 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.028529 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.028511 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:19.028631 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.028574 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:19.028755 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.028736 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-765fd\"" Jun 03 19:29:19.028968 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.028953 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:29:19.030815 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.030797 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.033116 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.033094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.033932 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.033707 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:29:19.035015 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.034996 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:29:19.035130 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.035111 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-465nq\"" Jun 03 19:29:19.035597 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.035566 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.035975 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.035944 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.036160 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.036076 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:29:19.036720 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.036286 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:19.036720 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.036353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.036720 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.036629 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:29:19.037206 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.037187 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7xw9\"" Jun 03 19:29:19.038517 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.038500 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:29:19.039074 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039056 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wsl9\"" Jun 03 19:29:19.039273 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039256 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.039343 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.039399 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.039368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:19.039454 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039445 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.039755 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039733 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:29:19.039755 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039744 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:29:19.039959 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.039861 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:29:19.041765 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.041745 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.041844 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.041825 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:19.043956 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.043935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kts4n\" (UniqueName: \"kubernetes.io/projected/36d41982-7cb1-446a-a9ff-2466e9b810cb-kube-api-access-kts4n\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.044046 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.043969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044046 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.043995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.044046 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-host\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.044046 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-daemon-config\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-registration-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16354d68-0ac3-4a7a-b8e0-8f88830365c6-konnectivity-ca\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-slash\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-netd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-env-overrides\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw2jh\" (UniqueName: \"kubernetes.io/projected/9ca2744c-7324-44bd-a1df-cfcb107f141f-kube-api-access-nw2jh\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-hostroot\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-systemd-units\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044230 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.044257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-script-lib\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-sys\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-os-release\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-kubelet\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044348 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-var-lib-kubelet\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-kubelet\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-netns\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044388 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-config\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-os-release\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-ovn\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-var-lib-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-multus\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-sys-fs\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:19.044780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-modprobe-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysconfig\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-systemd\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-k8s-cni-cncf-io\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-multus-certs\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-kubernetes\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cni-binary-copy\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c09866ce-7102-4ec0-8070-78375d14d89e-host-slash\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-socket-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-device-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.044993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16354d68-0ac3-4a7a-b8e0-8f88830365c6-agent-certs\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjf2d\" (UniqueName: \"kubernetes.io/projected/1b0676b4-b9a3-4122-a722-743efdd3283e-kube-api-access-tjf2d\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-lib-modules\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.045580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2vq\" (UniqueName: \"kubernetes.io/projected/1403b23f-c00d-4412-9ed4-5209e7c18301-kube-api-access-kg2vq\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-run\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-tmp\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-system-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-netns\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-conf-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-etc-kubernetes\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-conf\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbvl2\" (UniqueName: \"kubernetes.io/projected/c09866ce-7102-4ec0-8070-78375d14d89e-kube-api-access-bbvl2\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-cnibin\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-node-log\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-bin\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b0676b4-b9a3-4122-a722-743efdd3283e-ovn-node-metrics-cert\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwgv\" (UniqueName: \"kubernetes.io/projected/4bf0bd33-761a-42b4-aff1-f11a3728e74c-kube-api-access-kgwgv\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-systemd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-log-socket\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.046346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-system-cni-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-etc-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-socket-dir-parent\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045748 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-bin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-tuned\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cnibin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.045828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c09866ce-7102-4ec0-8070-78375d14d89e-iptables-alerter-script\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.046571 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.046890 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9f7l\"" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.046987 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.046995 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.047126 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.046987 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:29:19.048942 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.048920 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qkvc9\"" Jun 03 19:29:19.048942 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.048937 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:29:19.049178 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.049158 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:29:19.049252 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.049184 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:29:19.068677 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.068657 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-99zxs" Jun 03 19:29:19.077119 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.077097 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-99zxs" Jun 03 19:29:19.108408 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.108393 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:19.117354 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.117328 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:29:19.117438 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.117378 2558 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jun 03 19:29:19.134563 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.134540 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:29:19.135379 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.135349 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf58a5bde777f1d7261b6f09eb43ff777646642310776b8134fd8d1e1d8d771b\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8: Digest did not match, expected sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podUID="03c065fca101d5f39c7adc677b1cb157" Jun 03 19:29:19.146088 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16354d68-0ac3-4a7a-b8e0-8f88830365c6-konnectivity-ca\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.146169 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-slash\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146169 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-netd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146169 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.146316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-env-overrides\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-slash\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw2jh\" (UniqueName: \"kubernetes.io/projected/9ca2744c-7324-44bd-a1df-cfcb107f141f-kube-api-access-nw2jh\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.146316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-netd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146282 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146327 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-hostroot\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-systemd-units\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-script-lib\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-sys\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-os-release\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-systemd-units\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-kubelet\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b21ddd88-5737-45b4-a4e6-caff70db04ee-hosts-file\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-var-lib-kubelet\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.146548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-kubelet\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-netns\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-env-overrides\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-os-release\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-sys\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-netns\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-hostroot\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-var-lib-kubelet\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-config\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-kubelet\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146682 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-kubelet\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146687 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16354d68-0ac3-4a7a-b8e0-8f88830365c6-konnectivity-ca\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-os-release\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-os-release\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-ovn\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21ddd88-5737-45b4-a4e6-caff70db04ee-tmp-dir\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-kubelet-config\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.147103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-var-lib-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-ovn\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-host\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5rxb\" (UniqueName: \"kubernetes.io/projected/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-kube-api-access-s5rxb\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-multus\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-var-lib-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-sys-fs\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.146959 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-multus\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-sys-fs\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-modprobe-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147147 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysconfig\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-systemd\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147175 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-script-lib\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysconfig\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-k8s-cni-cncf-io\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b0676b4-b9a3-4122-a722-743efdd3283e-ovnkube-config\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-multus-certs\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-systemd\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-kubernetes\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-k8s-cni-cncf-io\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-modprobe-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-multus-certs\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cni-binary-copy\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-kubernetes\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbpm\" (UniqueName: \"kubernetes.io/projected/b3800785-1ff3-45a4-8249-27ed1300a522-kube-api-access-9gbpm\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c09866ce-7102-4ec0-8070-78375d14d89e-host-slash\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-socket-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.148821 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-device-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147399 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c09866ce-7102-4ec0-8070-78375d14d89e-host-slash\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16354d68-0ac3-4a7a-b8e0-8f88830365c6-agent-certs\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjf2d\" (UniqueName: \"kubernetes.io/projected/1b0676b4-b9a3-4122-a722-743efdd3283e-kube-api-access-tjf2d\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-lib-modules\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2vq\" (UniqueName: \"kubernetes.io/projected/1403b23f-c00d-4412-9ed4-5209e7c18301-kube-api-access-kg2vq\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-run\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-tmp\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-socket-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147769 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cni-binary-copy\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-system-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-netns\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.149656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-lib-modules\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-conf-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-run\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-etc-kubernetes\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-conf\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-run-netns\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbvl2\" (UniqueName: \"kubernetes.io/projected/c09866ce-7102-4ec0-8070-78375d14d89e-kube-api-access-bbvl2\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-etc-kubernetes\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148084 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-system-cni-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.147902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-conf-dir\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-cnibin\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-conf\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-node-log\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-cnibin\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-bin\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-node-log\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b0676b4-b9a3-4122-a722-743efdd3283e-ovn-node-metrics-cert\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-host-cni-bin\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.150544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148323 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwgv\" (UniqueName: \"kubernetes.io/projected/4bf0bd33-761a-42b4-aff1-f11a3728e74c-kube-api-access-kgwgv\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4h9d\" (UniqueName: \"kubernetes.io/projected/b21ddd88-5737-45b4-a4e6-caff70db04ee-kube-api-access-c4h9d\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-systemd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-log-socket\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-systemd\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148464 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-dbus\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-system-cni-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148492 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-log-socket\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-etc-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-device-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d41982-7cb1-446a-a9ff-2466e9b810cb-system-cni-dir\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-socket-dir-parent\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-bin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-serviceca\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.151308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-socket-dir-parent\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-tuned\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-host-var-lib-cni-bin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.148924 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-etc-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cnibin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bf0bd33-761a-42b4-aff1-f11a3728e74c-cnibin\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149213 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d41982-7cb1-446a-a9ff-2466e9b810cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c09866ce-7102-4ec0-8070-78375d14d89e-iptables-alerter-script\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kts4n\" (UniqueName: \"kubernetes.io/projected/36d41982-7cb1-446a-a9ff-2466e9b810cb-kube-api-access-kts4n\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b0676b4-b9a3-4122-a722-743efdd3283e-run-openvswitch\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-sysctl-d\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-host\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-daemon-config\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.151969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-registration-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ca2744c-7324-44bd-a1df-cfcb107f141f-host\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.149957 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c09866ce-7102-4ec0-8070-78375d14d89e-iptables-alerter-script\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.150255 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bf0bd33-761a-42b4-aff1-f11a3728e74c-multus-daemon-config\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.150375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1403b23f-c00d-4412-9ed4-5209e7c18301-registration-dir\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.151555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-etc-tuned\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.151575 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca2744c-7324-44bd-a1df-cfcb107f141f-tmp\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.151638 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b0676b4-b9a3-4122-a722-743efdd3283e-ovn-node-metrics-cert\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.152453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.151739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16354d68-0ac3-4a7a-b8e0-8f88830365c6-agent-certs\") pod \"konnectivity-agent-jvpc6\" (UID: \"16354d68-0ac3-4a7a-b8e0-8f88830365c6\") " pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.153363 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.153342 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:19.153459 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.153368 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:19.153459 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.153378 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:19.153459 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.153446 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:19.653412354 +0000 UTC m=+3.046937257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:19.154711 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.154675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw2jh\" (UniqueName: \"kubernetes.io/projected/9ca2744c-7324-44bd-a1df-cfcb107f141f-kube-api-access-nw2jh\") pod \"tuned-qm868\" (UID: \"9ca2744c-7324-44bd-a1df-cfcb107f141f\") " pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.155741 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.155723 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbvl2\" (UniqueName: \"kubernetes.io/projected/c09866ce-7102-4ec0-8070-78375d14d89e-kube-api-access-bbvl2\") pod \"iptables-alerter-ld5zx\" (UID: \"c09866ce-7102-4ec0-8070-78375d14d89e\") " pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.156345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.156324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2vq\" (UniqueName: \"kubernetes.io/projected/1403b23f-c00d-4412-9ed4-5209e7c18301-kube-api-access-kg2vq\") pod \"aws-ebs-csi-driver-node-4jg96\" (UID: \"1403b23f-c00d-4412-9ed4-5209e7c18301\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.156896 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.156844 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwgv\" (UniqueName: \"kubernetes.io/projected/4bf0bd33-761a-42b4-aff1-f11a3728e74c-kube-api-access-kgwgv\") pod \"multus-s9lwm\" (UID: \"4bf0bd33-761a-42b4-aff1-f11a3728e74c\") " pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.157286 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.157267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjf2d\" (UniqueName: \"kubernetes.io/projected/1b0676b4-b9a3-4122-a722-743efdd3283e-kube-api-access-tjf2d\") pod \"ovnkube-node-tqb5x\" (UID: \"1b0676b4-b9a3-4122-a722-743efdd3283e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.158272 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.158255 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kts4n\" (UniqueName: \"kubernetes.io/projected/36d41982-7cb1-446a-a9ff-2466e9b810cb-kube-api-access-kts4n\") pod \"multus-additional-cni-plugins-r7tkx\" (UID: \"36d41982-7cb1-446a-a9ff-2466e9b810cb\") " pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.251260 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4h9d\" (UniqueName: \"kubernetes.io/projected/b21ddd88-5737-45b4-a4e6-caff70db04ee-kube-api-access-c4h9d\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.251260 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-dbus\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-serviceca\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b21ddd88-5737-45b4-a4e6-caff70db04ee-hosts-file\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21ddd88-5737-45b4-a4e6-caff70db04ee-tmp-dir\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-kubelet-config\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251427 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-dbus\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-host\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5rxb\" (UniqueName: \"kubernetes.io/projected/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-kube-api-access-s5rxb\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.251494 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.251469 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-host\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251461 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b21ddd88-5737-45b4-a4e6-caff70db04ee-hosts-file\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.251541 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:19.751520401 +0000 UTC m=+3.145045309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acd494d0-55f8-4f38-8c26-1ce04f072b0a-kubelet-config\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbpm\" (UniqueName: \"kubernetes.io/projected/b3800785-1ff3-45a4-8249-27ed1300a522-kube-api-access-9gbpm\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.251679 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251702 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21ddd88-5737-45b4-a4e6-caff70db04ee-tmp-dir\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.251738 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:19.75172158 +0000 UTC m=+3.145246470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:19.251916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.251835 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-serviceca\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.260237 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.260187 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbpm\" (UniqueName: \"kubernetes.io/projected/b3800785-1ff3-45a4-8249-27ed1300a522-kube-api-access-9gbpm\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.260344 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.260239 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4h9d\" (UniqueName: \"kubernetes.io/projected/b21ddd88-5737-45b4-a4e6-caff70db04ee-kube-api-access-c4h9d\") pod \"node-resolver-bptc6\" (UID: \"b21ddd88-5737-45b4-a4e6-caff70db04ee\") " pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.260584 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.260569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5rxb\" (UniqueName: \"kubernetes.io/projected/9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4-kube-api-access-s5rxb\") pod \"node-ca-9zshw\" (UID: \"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4\") " pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.331334 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.331300 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm868" Jun 03 19:29:19.340607 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.340581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" Jun 03 19:29:19.340948 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.340919 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca2744c_7324_44bd_a1df_cfcb107f141f.slice/crio-b10704e7ee020316e58d62ff4e8ff9723e519d4bb07a6d76e1f84f21aaff6224 WatchSource:0}: Error finding container b10704e7ee020316e58d62ff4e8ff9723e519d4bb07a6d76e1f84f21aaff6224: Status 404 returned error can't find the container with id b10704e7ee020316e58d62ff4e8ff9723e519d4bb07a6d76e1f84f21aaff6224 Jun 03 19:29:19.349272 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.349250 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" Jun 03 19:29:19.349505 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.349477 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d41982_7cb1_446a_a9ff_2466e9b810cb.slice/crio-49c9955638d1af4fe28f9ff1352164d6d2482a020c02bd2b5dd85891a8870d86 WatchSource:0}: Error finding container 49c9955638d1af4fe28f9ff1352164d6d2482a020c02bd2b5dd85891a8870d86: Status 404 returned error can't find the container with id 49c9955638d1af4fe28f9ff1352164d6d2482a020c02bd2b5dd85891a8870d86 Jun 03 19:29:19.355314 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.355293 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9lwm" Jun 03 19:29:19.359050 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.359023 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1403b23f_c00d_4412_9ed4_5209e7c18301.slice/crio-164873dfcec8cf2adc45f011dd941c325df8e6d3c5c3a3c750add85515f3224a WatchSource:0}: Error finding container 164873dfcec8cf2adc45f011dd941c325df8e6d3c5c3a3c750add85515f3224a: Status 404 returned error can't find the container with id 164873dfcec8cf2adc45f011dd941c325df8e6d3c5c3a3c750add85515f3224a Jun 03 19:29:19.363969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.363685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ld5zx" Jun 03 19:29:19.366773 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.366752 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf0bd33_761a_42b4_aff1_f11a3728e74c.slice/crio-315a7d80418eb021aa16deaf6bd60857300da365ead878abc79dec14ba1751e8 WatchSource:0}: Error finding container 315a7d80418eb021aa16deaf6bd60857300da365ead878abc79dec14ba1751e8: Status 404 returned error can't find the container with id 315a7d80418eb021aa16deaf6bd60857300da365ead878abc79dec14ba1751e8 Jun 03 19:29:19.370778 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.370755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:19.373631 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.373609 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09866ce_7102_4ec0_8070_78375d14d89e.slice/crio-cb13ed77b313fa37411056b4473d40f5dd39566e02e2583cafdc4a73260d740f WatchSource:0}: Error finding container cb13ed77b313fa37411056b4473d40f5dd39566e02e2583cafdc4a73260d740f: Status 404 returned error can't find the container with id cb13ed77b313fa37411056b4473d40f5dd39566e02e2583cafdc4a73260d740f Jun 03 19:29:19.379120 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.379089 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:19.380931 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.380912 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16354d68_0ac3_4a7a_b8e0_8f88830365c6.slice/crio-7b792371a03a08b25112a60b3bc9f479b2f93f7b5be9e223b0f42cbe0c08bd31 WatchSource:0}: Error finding container 7b792371a03a08b25112a60b3bc9f479b2f93f7b5be9e223b0f42cbe0c08bd31: Status 404 returned error can't find the container with id 7b792371a03a08b25112a60b3bc9f479b2f93f7b5be9e223b0f42cbe0c08bd31 Jun 03 19:29:19.385956 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.385924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bptc6" Jun 03 19:29:19.390311 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.390295 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zshw" Jun 03 19:29:19.390480 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.390461 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0676b4_b9a3_4122_a722_743efdd3283e.slice/crio-7a44dd37587c5f2dda26a385c0681ad8c7f210431cd8deb7eefe53e12192c71b WatchSource:0}: Error finding container 7a44dd37587c5f2dda26a385c0681ad8c7f210431cd8deb7eefe53e12192c71b: Status 404 returned error can't find the container with id 7a44dd37587c5f2dda26a385c0681ad8c7f210431cd8deb7eefe53e12192c71b Jun 03 19:29:19.399656 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:19.399601 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c40e8a6_2d9c_49bc_ae5a_a00d411c44c4.slice/crio-bdabb58df7bafead9434a5c0fe7c6ae7e78e08040cc3fa9df1df77e8c5f8b9bf WatchSource:0}: Error finding container bdabb58df7bafead9434a5c0fe7c6ae7e78e08040cc3fa9df1df77e8c5f8b9bf: Status 404 returned error can't find the container with id bdabb58df7bafead9434a5c0fe7c6ae7e78e08040cc3fa9df1df77e8c5f8b9bf Jun 03 19:29:19.654817 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.654702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:19.654980 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.654877 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:19.654980 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.654897 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:19.654980 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.654909 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:19.654980 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.654962 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:20.654947804 +0000 UTC m=+4.048472689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:19.756016 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.755971 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:19.756171 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:19.756029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:19.756171 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.756128 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:19.756309 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.756128 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:19.756309 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.756284 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:20.756231637 +0000 UTC m=+4.149756525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:19.756416 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:19.756330 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:20.75629233 +0000 UTC m=+4.149817216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:20.080830 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.080707 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:24:19 +0000 UTC" deadline="2028-01-11 11:49:41.512577955 +0000 UTC" Jun 03 19:29:20.080830 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.080783 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14080h20m21.431800426s" Jun 03 19:29:20.103523 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.103495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:20.103690 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.103623 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:20.104037 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.104017 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:20.104142 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.104120 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:20.123831 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.123796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerStarted","Data":"49c9955638d1af4fe28f9ff1352164d6d2482a020c02bd2b5dd85891a8870d86"} Jun 03 19:29:20.144172 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.144083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ld5zx" event={"ID":"c09866ce-7102-4ec0-8070-78375d14d89e","Type":"ContainerStarted","Data":"cb13ed77b313fa37411056b4473d40f5dd39566e02e2583cafdc4a73260d740f"} Jun 03 19:29:20.169538 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.153539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm868" event={"ID":"9ca2744c-7324-44bd-a1df-cfcb107f141f","Type":"ContainerStarted","Data":"b10704e7ee020316e58d62ff4e8ff9723e519d4bb07a6d76e1f84f21aaff6224"} Jun 03 19:29:20.171456 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.171421 2558 generic.go:356] "Generic (PLEG): container finished" podID="63a83ba7fe97524b277084ee29b816f7" containerID="aacb6d15af8523b40b9af938d484219c75b1a65fd7f73ddbc0581adeb58516c1" exitCode=0 Jun 03 19:29:20.171600 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.171514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"63a83ba7fe97524b277084ee29b816f7","Type":"ContainerDied","Data":"aacb6d15af8523b40b9af938d484219c75b1a65fd7f73ddbc0581adeb58516c1"} Jun 03 19:29:20.192102 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.192028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zshw" event={"ID":"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4","Type":"ContainerStarted","Data":"bdabb58df7bafead9434a5c0fe7c6ae7e78e08040cc3fa9df1df77e8c5f8b9bf"} Jun 03 19:29:20.196836 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.196805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bptc6" event={"ID":"b21ddd88-5737-45b4-a4e6-caff70db04ee","Type":"ContainerStarted","Data":"f17ce5aae1f2c4b0d76db3f7f9408558f75e14eac3b2486c8497b0a6d34b215e"} Jun 03 19:29:20.212272 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.212241 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"7a44dd37587c5f2dda26a385c0681ad8c7f210431cd8deb7eefe53e12192c71b"} Jun 03 19:29:20.222612 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.222576 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvpc6" event={"ID":"16354d68-0ac3-4a7a-b8e0-8f88830365c6","Type":"ContainerStarted","Data":"7b792371a03a08b25112a60b3bc9f479b2f93f7b5be9e223b0f42cbe0c08bd31"} Jun 03 19:29:20.242914 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.242862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9lwm" event={"ID":"4bf0bd33-761a-42b4-aff1-f11a3728e74c","Type":"ContainerStarted","Data":"315a7d80418eb021aa16deaf6bd60857300da365ead878abc79dec14ba1751e8"} Jun 03 19:29:20.270923 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.270821 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" event={"ID":"1403b23f-c00d-4412-9ed4-5209e7c18301","Type":"ContainerStarted","Data":"164873dfcec8cf2adc45f011dd941c325df8e6d3c5c3a3c750add85515f3224a"} Jun 03 19:29:20.275026 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.274903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf58a5bde777f1d7261b6f09eb43ff777646642310776b8134fd8d1e1d8d771b\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8: Digest did not match, expected sha256:fd5030dffd00d404575afcc481927b52dc8d1ef972e6caf836d7018225bdc1e8, got sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podUID="03c065fca101d5f39c7adc677b1cb157" Jun 03 19:29:20.664425 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.664338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:20.664598 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.664501 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:20.664598 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.664519 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:20.664598 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.664532 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:20.664598 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.664588 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:22.66456929 +0000 UTC m=+6.058094179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:20.765484 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.765450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:20.765673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.765518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:20.765673 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.765576 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:20.765673 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.765650 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:22.765629475 +0000 UTC m=+6.159154385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:20.765673 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.765650 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:20.765921 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:20.765690 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:22.765680353 +0000 UTC m=+6.159205245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:20.873332 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:20.873292 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:21.081048 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:21.080931 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:24:19 +0000 UTC" deadline="2028-01-10 12:56:08.892963995 +0000 UTC" Jun 03 19:29:21.081048 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:21.080998 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14057h26m47.811970206s" Jun 03 19:29:21.105779 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:21.105735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:21.105962 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:21.105891 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:21.288403 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:21.288299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"63a83ba7fe97524b277084ee29b816f7","Type":"ContainerStarted","Data":"a6c91655623b837a75d3ca43ca6213036759e9fffb08bbe86077f9a2c0de73ea"} Jun 03 19:29:22.103193 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:22.103157 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:22.103661 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.103291 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:22.103722 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:22.103711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:22.103867 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.103814 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:22.682576 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:22.682522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:22.682747 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.682683 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:22.682747 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.682708 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:22.682747 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.682720 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:22.682950 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.682791 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:26.682771976 +0000 UTC m=+10.076296875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:22.783554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:22.783515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:22.783739 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:22.783609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:22.783808 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.783757 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:22.783914 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.783822 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:26.783803691 +0000 UTC m=+10.177328580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:22.784257 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.784237 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:22.784325 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:22.784297 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:26.784280969 +0000 UTC m=+10.177805862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:23.104089 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:23.103820 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:23.104089 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:23.104000 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:24.103440 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:24.103405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:24.103619 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:24.103405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:24.103619 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:24.103569 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:24.103748 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:24.103613 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:25.104664 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:25.103336 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:25.104664 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:25.103482 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:26.104251 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:26.104119 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:26.104251 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:26.104168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:26.104486 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.104270 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:26.104486 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.104395 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:26.716157 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:26.715747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:26.716157 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.715949 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:26.716157 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.715968 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:26.716157 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.715979 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:26.716157 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.716032 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:34.716014437 +0000 UTC m=+18.109539326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:26.816814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:26.816915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.817048 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.817109 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:34.817092713 +0000 UTC m=+18.210617616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.817160 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:26.817446 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:26.817202 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:34.817188917 +0000 UTC m=+18.210713815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:27.105361 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:27.105283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:27.106714 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:27.106345 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:28.103803 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:28.103764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:28.104318 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:28.103973 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:28.104318 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:28.103764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:28.104318 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:28.104156 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:29.104020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:29.103983 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:29.104506 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:29.104154 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:30.103665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:30.103586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:30.103824 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:30.103587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:30.103824 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:30.103707 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:30.103824 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:30.103792 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:31.103386 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:31.103349 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:31.103897 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:31.103486 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:32.103642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:32.103603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:32.104127 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:32.103650 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:32.104127 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:32.103721 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:32.104127 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:32.103870 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:33.103618 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:33.103583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:33.103806 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:33.103749 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:34.103553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:34.103512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:34.103553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:34.103542 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:34.104236 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.103653 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:34.104236 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.103798 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:34.778486 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:34.778442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:34.778672 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.778627 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:34.778672 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.778654 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:34.778672 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.778667 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:34.778834 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.778730 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:50.778711472 +0000 UTC m=+34.172236380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:34.879467 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:34.879432 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:34.879657 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:34.879494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:34.879657 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.879601 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:34.879657 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.879611 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:34.879797 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.879662 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:29:50.879648843 +0000 UTC m=+34.273173728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:34.879797 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:34.879678 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:50.879669873 +0000 UTC m=+34.273194759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:35.104091 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:35.104000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:35.104539 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:35.104144 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:36.103550 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:36.103513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:36.103550 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:36.103520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:36.103801 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:36.103747 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:36.103883 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:36.103821 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:37.103773 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:37.103739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:37.104227 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:37.103839 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:38.104466 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.104134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:38.105164 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.104144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:38.105164 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:38.104561 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:38.105164 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:38.104660 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:38.325211 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.325179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bptc6" event={"ID":"b21ddd88-5737-45b4-a4e6-caff70db04ee","Type":"ContainerStarted","Data":"3abdace110df7b9ddf0742a2517a4a63931a89c2755e43925476ce923b9db49e"} Jun 03 19:29:38.329016 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.328990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"ac8904eb995c640c2a7add3778e4a05b4d1b84d96ebb75cd9f4dc5c873cfd025"} Jun 03 19:29:38.329129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.329070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"db6d8cdfc6802bad9c546a34144408a2e6d97b85b13a7b76c1ad5f721688de74"} Jun 03 19:29:38.329129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.329122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"d8046b4740477ebb73f455af77f4c49d220ee088f5be381b63520cbae5194a9e"} Jun 03 19:29:38.329236 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.329171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"63b0498982671d684a66127a797738533adaf2750cd07625bd40a908eb43aa8a"} Jun 03 19:29:38.329236 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.329217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"3ca253f8f8fed6f16a9b8c495bfa3c0b9d70895eab8ec2439f6ea9898a3e0854"} Jun 03 19:29:38.329328 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.329264 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"5763bac478888e5ba8aed43a9fee8132a79f685b0d4bedbf74a168d71501a9ff"} Jun 03 19:29:38.330675 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.330648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvpc6" event={"ID":"16354d68-0ac3-4a7a-b8e0-8f88830365c6","Type":"ContainerStarted","Data":"188c3c4dcea4922aefb984a423369fbd4d712538d26240e54ff7ffb414d95b0e"} Jun 03 19:29:38.332324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.332299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9lwm" event={"ID":"4bf0bd33-761a-42b4-aff1-f11a3728e74c","Type":"ContainerStarted","Data":"aa889d56c342d960559053a51cb40cbe02286582a0d2e6a568e1ced25e6649de"} Jun 03 19:29:38.333899 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.333876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" event={"ID":"1403b23f-c00d-4412-9ed4-5209e7c18301","Type":"ContainerStarted","Data":"3b2b8269d46492244ee473d31b076f6a76ba50ee701160f530df088faecbc929"} Jun 03 19:29:38.335588 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.335501 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="32eae06aee7a33dafd190697dbbe9347098b28157ab302247382a2ed989f4b5b" exitCode=0 Jun 03 19:29:38.335588 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.335532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"32eae06aee7a33dafd190697dbbe9347098b28157ab302247382a2ed989f4b5b"} Jun 03 19:29:38.337349 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.337273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm868" event={"ID":"9ca2744c-7324-44bd-a1df-cfcb107f141f","Type":"ContainerStarted","Data":"1223e0959f2238be65b6d3e53d30b20d29e01cdb2dba46f8e58a2dc23bc6b724"} Jun 03 19:29:38.342501 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.341031 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" podStartSLOduration=20.341004445 podStartE2EDuration="20.341004445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:21.30456509 +0000 UTC m=+4.698090000" watchObservedRunningTime="2026-06-03 19:29:38.341004445 +0000 UTC m=+21.734529353" Jun 03 19:29:38.342501 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.341105 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zshw" event={"ID":"9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4","Type":"ContainerStarted","Data":"b10a58cf884d06dc2ef86e396393a1f805e4a0c424e5c0dfbb530b6a7123ebd8"} Jun 03 19:29:38.359190 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.359145 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qm868" podStartSLOduration=3.127786215 podStartE2EDuration="21.359128685s" totalImagesPullingTime="18.23134247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:38.359111742 +0000 UTC m=+21.752636651" watchObservedRunningTime="2026-06-03 19:29:38.359128685 +0000 UTC m=+21.752653594" Jun 03 19:29:38.359349 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.359282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bptc6" podStartSLOduration=3.173206707 podStartE2EDuration="21.359265634s" totalImagesPullingTime="18.186058927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:38.342213495 +0000 UTC m=+21.735738404" watchObservedRunningTime="2026-06-03 19:29:38.359265634 +0000 UTC m=+21.752790546" Jun 03 19:29:38.375322 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.375267 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s9lwm" podStartSLOduration=3.120773552 podStartE2EDuration="21.375250048s" totalImagesPullingTime="18.254476496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:38.374793202 +0000 UTC m=+21.768318136" watchObservedRunningTime="2026-06-03 19:29:38.375250048 +0000 UTC m=+21.768774961" Jun 03 19:29:38.391291 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.391235 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9zshw" podStartSLOduration=3.2181372169999998 podStartE2EDuration="21.391217864s" totalImagesPullingTime="18.173080647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:38.391192284 +0000 UTC m=+21.784717193" watchObservedRunningTime="2026-06-03 19:29:38.391217864 +0000 UTC m=+21.784742773" Jun 03 19:29:38.440442 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.440381 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jvpc6" podStartSLOduration=3.248517446 podStartE2EDuration="21.440353755s" totalImagesPullingTime="18.191836309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:38.44012946 +0000 UTC m=+21.833654369" watchObservedRunningTime="2026-06-03 19:29:38.440353755 +0000 UTC m=+21.833878664" Jun 03 19:29:38.824873 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.824823 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:38.825815 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:38.825788 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:39.103509 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.103476 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:39.103658 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:39.103599 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:39.345461 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.345369 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ld5zx" event={"ID":"c09866ce-7102-4ec0-8070-78375d14d89e","Type":"ContainerStarted","Data":"729ae439f809c493808bef0b0c00c28a7fb0b0306cb3f14e02cb0b88d9d9e91a"} Jun 03 19:29:39.345925 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.345632 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:39.346329 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.346307 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jvpc6" Jun 03 19:29:39.361568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.361523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ld5zx" podStartSLOduration=4.156413386 podStartE2EDuration="22.361506015s" totalImagesPullingTime="18.205092629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:39.361036904 +0000 UTC m=+22.754561813" watchObservedRunningTime="2026-06-03 19:29:39.361506015 +0000 UTC m=+22.755030922" Jun 03 19:29:39.906262 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:39.906219 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:29:40.103983 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.103953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:40.104193 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.103966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:40.104193 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:40.104086 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:40.104193 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:40.104179 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:40.104495 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.104414 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:29:39.906244126Z","UUID":"9d636a0b-cbc7-4ff7-b1f5-a9eec3f00fa7","Handler":null,"Name":"","Endpoint":""} Jun 03 19:29:40.106196 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.106174 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:29:40.106196 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.106200 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:29:40.349923 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.349783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" event={"ID":"1403b23f-c00d-4412-9ed4-5209e7c18301","Type":"ContainerStarted","Data":"5ce4abffd2b1335c4ae4ed6ee1d85357c672f5a3ef52893be311ee4e3bde8f00"} Jun 03 19:29:40.351476 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.351441 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"03c065fca101d5f39c7adc677b1cb157","Type":"ContainerStarted","Data":"a57af953f2493762bec78d73bde2a5ab329da0c94fdb4b46e04c0861a36a76b0"} Jun 03 19:29:40.366436 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:40.366325 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podStartSLOduration=22.366308803 podStartE2EDuration="22.366308803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:40.36571335 +0000 UTC m=+23.759238259" watchObservedRunningTime="2026-06-03 19:29:40.366308803 +0000 UTC m=+23.759833711" Jun 03 19:29:41.103586 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:41.103370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:41.103926 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:41.103707 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:41.358148 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:41.358070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"8f8921b2bf2040e4a26687047bbbbbbe5682414e12ca014fb9ee246a2e6b5871"} Jun 03 19:29:42.104025 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:42.103992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:42.104254 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:42.103992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:42.104254 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:42.104105 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:42.104254 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:42.104198 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:42.362621 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:42.362528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" event={"ID":"1403b23f-c00d-4412-9ed4-5209e7c18301","Type":"ContainerStarted","Data":"93648a935fca109e210336895c162d461465d2a6f52c95352718b68e48e39efb"} Jun 03 19:29:42.387910 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:42.387794 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jg96" podStartSLOduration=3.738168794 podStartE2EDuration="25.387770303s" totalImagesPullingTime="21.649601509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:42.384175837 +0000 UTC m=+25.777700745" watchObservedRunningTime="2026-06-03 19:29:42.387770303 +0000 UTC m=+25.781295214" Jun 03 19:29:43.103529 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:43.103448 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:43.103678 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:43.103572 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:43.368004 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:43.367923 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" event={"ID":"1b0676b4-b9a3-4122-a722-743efdd3283e","Type":"ContainerStarted","Data":"6575e5274693d9369f7e7d09512f271ce594382ab91b873f4106a6092469feab"} Jun 03 19:29:43.396386 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:43.396341 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" podStartSLOduration=8.143719923 podStartE2EDuration="26.396326101s" totalImagesPullingTime="18.252606178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:43.395671744 +0000 UTC m=+26.789196674" watchObservedRunningTime="2026-06-03 19:29:43.396326101 +0000 UTC m=+26.789851009" Jun 03 19:29:44.103229 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.103197 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:44.103415 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:44.103296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:44.103415 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.103347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:44.103490 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:44.103427 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:44.372431 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.372355 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="8a4b5f34ba363960b4a4b54706545cd59aa2e5298ad5f44e3be9063c56cc2b5c" exitCode=0 Jun 03 19:29:44.372873 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.372443 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"8a4b5f34ba363960b4a4b54706545cd59aa2e5298ad5f44e3be9063c56cc2b5c"} Jun 03 19:29:44.372946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.372895 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:44.373011 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.372980 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:44.373063 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.373030 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:44.388804 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.388773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:44.388958 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:44.388910 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:29:45.103761 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.103728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:45.104037 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:45.103885 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:45.211811 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.211776 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zm2zr"] Jun 03 19:29:45.211994 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.211944 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:45.212091 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:45.212068 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:45.215183 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.215154 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6hqpg"] Jun 03 19:29:45.215325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.215283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:45.215415 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:45.215392 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:45.215914 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.215890 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x2z9d"] Jun 03 19:29:45.377547 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.377515 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerStarted","Data":"887bbd4cf9c4434ede84205344f2bb72559fd4d72db192aedaa57badcf9d88be"} Jun 03 19:29:45.377914 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:45.377554 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:45.377914 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:45.377901 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:46.381726 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:46.381692 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="887bbd4cf9c4434ede84205344f2bb72559fd4d72db192aedaa57badcf9d88be" exitCode=0 Jun 03 19:29:46.382131 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:46.381769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"887bbd4cf9c4434ede84205344f2bb72559fd4d72db192aedaa57badcf9d88be"} Jun 03 19:29:47.104355 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:47.104273 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:47.104355 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:47.104295 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:47.104568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:47.104386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:47.104568 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:47.104475 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:47.104783 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:47.104747 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:47.104917 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:47.104804 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:48.388917 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:48.388712 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="7631fdc18f861ba36ccc0b91cefe7fb5a20ec1c39c33d687f294ebed51dc82dc" exitCode=0 Jun 03 19:29:48.388917 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:48.388797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"7631fdc18f861ba36ccc0b91cefe7fb5a20ec1c39c33d687f294ebed51dc82dc"} Jun 03 19:29:49.103809 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:49.103716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:49.104018 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:49.103716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:49.104018 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:49.103845 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:49.104018 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:49.103880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:49.104018 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:49.103997 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:49.104196 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:49.104092 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:50.794927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:50.794891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:50.795413 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.795025 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:50.795413 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.795042 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:50.795413 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.795052 2558 projected.go:196] Error preparing data for projected volume kube-api-access-x6w76 for pod openshift-network-diagnostics/network-check-target-6hqpg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:50.795413 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.795110 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76 podName:88d0fd8c-5925-479f-b56d-b9bee2d4dd6a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.795090733 +0000 UTC m=+66.188615621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x6w76" (UniqueName: "kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76") pod "network-check-target-6hqpg" (UID: "88d0fd8c-5925-479f-b56d-b9bee2d4dd6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:50.895773 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:50.895738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:50.895978 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:50.895789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:50.895978 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.895917 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:50.895978 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.895917 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:50.896104 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.895984 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret podName:acd494d0-55f8-4f38-8c26-1ce04f072b0a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.895969424 +0000 UTC m=+66.289494313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret") pod "global-pull-secret-syncer-zm2zr" (UID: "acd494d0-55f8-4f38-8c26-1ce04f072b0a") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:50.896104 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:50.896004 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.895994173 +0000 UTC m=+66.289519059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:51.103468 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.103371 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:51.103468 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.103416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:51.103468 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.103376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:51.103748 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.103511 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hqpg" podUID="88d0fd8c-5925-479f-b56d-b9bee2d4dd6a" Jun 03 19:29:51.103748 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.103607 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zm2zr" podUID="acd494d0-55f8-4f38-8c26-1ce04f072b0a" Jun 03 19:29:51.103748 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.103684 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x2z9d" podUID="b3800785-1ff3-45a4-8249-27ed1300a522" Jun 03 19:29:51.412345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.412272 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeReady" Jun 03 19:29:51.412489 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.412402 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:29:51.445979 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.445944 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:29:51.450154 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.450130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.452445 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.452422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:29:51.452585 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.452422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djr9z\"" Jun 03 19:29:51.452585 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.452422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:29:51.452688 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.452593 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:29:51.461384 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.461360 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:29:51.462428 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.462289 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l8r76"] Jun 03 19:29:51.466417 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.466286 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:29:51.466417 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.466330 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-97lw7"] Jun 03 19:29:51.466629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.466440 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.468397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.468372 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:29:51.468397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.468388 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:29:51.468566 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.468412 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gklzb\"" Jun 03 19:29:51.470182 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.470161 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.472495 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.472115 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:29:51.472495 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.472353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:29:51.472495 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.472412 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:29:51.472495 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.472451 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mrws6\"" Jun 03 19:29:51.474485 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.474241 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8r76"] Jun 03 19:29:51.487525 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.487497 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-97lw7"] Jun 03 19:29:51.599420 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.599420 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599446 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkhs\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f88c\" (UniqueName: \"kubernetes.io/projected/eb9298ab-5021-46a3-85a4-bfb516910a53-kube-api-access-7f88c\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-config-volume\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rm9\" (UniqueName: \"kubernetes.io/projected/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-kube-api-access-p2rm9\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599621 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9298ab-5021-46a3-85a4-bfb516910a53-cert\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.599673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.600044 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.600044 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.600044 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.600044 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.599840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-tmp-dir\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.700800 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-config-volume\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.700800 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rm9\" (UniqueName: \"kubernetes.io/projected/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-kube-api-access-p2rm9\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.700800 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9298ab-5021-46a3-85a4-bfb516910a53-cert\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.700981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.701049 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:29:51.701104 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.701068 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:29:51.701397 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.701142 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:52.201120713 +0000 UTC m=+35.594645618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:29:51.701397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701241 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.701397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-tmp-dir\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.701397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-config-volume\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.701511 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:51.701561 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:52.201547419 +0000 UTC m=+35.595072305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkhs\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.701653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f88c\" (UniqueName: \"kubernetes.io/projected/eb9298ab-5021-46a3-85a4-bfb516910a53-kube-api-access-7f88c\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.701994 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701760 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-tmp-dir\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.701994 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.701885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.702567 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.702412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.706043 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.706014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.706162 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.706047 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.706162 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.706057 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9298ab-5021-46a3-85a4-bfb516910a53-cert\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.711660 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.711636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rm9\" (UniqueName: \"kubernetes.io/projected/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-kube-api-access-p2rm9\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:51.711764 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.711729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkhs\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.712082 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.712059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:51.712689 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.712622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f88c\" (UniqueName: \"kubernetes.io/projected/eb9298ab-5021-46a3-85a4-bfb516910a53-kube-api-access-7f88c\") pod \"ingress-canary-97lw7\" (UID: \"eb9298ab-5021-46a3-85a4-bfb516910a53\") " pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.784207 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.784166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-97lw7" Jun 03 19:29:51.927828 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:51.927616 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-97lw7"] Jun 03 19:29:51.933561 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:29:51.933530 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9298ab_5021_46a3_85a4_bfb516910a53.slice/crio-816dfee6181b6250c7d2701082be71cba0ea39d9dcf4917c2e82d666ef829382 WatchSource:0}: Error finding container 816dfee6181b6250c7d2701082be71cba0ea39d9dcf4917c2e82d666ef829382: Status 404 returned error can't find the container with id 816dfee6181b6250c7d2701082be71cba0ea39d9dcf4917c2e82d666ef829382 Jun 03 19:29:52.204863 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:52.204809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:52.205068 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:52.204975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:52.205068 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:52.204993 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:29:52.205068 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:52.205015 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:29:52.205068 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:52.205067 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:29:52.205263 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:52.205091 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:53.205069104 +0000 UTC m=+36.598593992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:29:52.205263 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:52.205110 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:53.205101102 +0000 UTC m=+36.598625989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:29:52.400822 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:52.400762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-97lw7" event={"ID":"eb9298ab-5021-46a3-85a4-bfb516910a53","Type":"ContainerStarted","Data":"816dfee6181b6250c7d2701082be71cba0ea39d9dcf4917c2e82d666ef829382"} Jun 03 19:29:53.103946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.103910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:29:53.104382 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.103910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:29:53.104730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.103910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:29:53.107123 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.107095 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:29:53.107894 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.107869 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvcxn\"" Jun 03 19:29:53.108012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.107924 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tx4t\"" Jun 03 19:29:53.108012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.107938 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:29:53.108404 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.108189 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:29:53.108404 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.108266 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:29:53.214831 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.214795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:53.215036 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:53.214905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:53.215036 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:53.215004 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:29:53.215036 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:53.215018 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:29:53.215191 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:53.215073 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:55.215059413 +0000 UTC m=+38.608584299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:29:53.215191 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:53.215016 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:29:53.215191 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:53.215175 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:55.215152517 +0000 UTC m=+38.608677411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:29:54.948897 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:54.948842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:55.040717 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.040685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:55.233011 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.232972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:55.233179 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.233039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:55.233179 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:55.233126 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:29:55.233179 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:55.233141 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:29:55.233179 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:55.233124 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:29:55.233329 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:55.233192 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:59.233178582 +0000 UTC m=+42.626703467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:29:55.233329 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:55.233203 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:59.23319796 +0000 UTC m=+42.626722845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:29:55.410151 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.410049 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-97lw7" event={"ID":"eb9298ab-5021-46a3-85a4-bfb516910a53","Type":"ContainerStarted","Data":"882fba5d19ac4a9641d1659131a63adc64842ba783dc350fce5ebfda829ee681"} Jun 03 19:29:55.412728 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.412698 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="9f32d95b589ff5fb7c775d3eea0a71b801a017b042aa0d7757b463bd510ee631" exitCode=0 Jun 03 19:29:55.412885 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.412740 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"9f32d95b589ff5fb7c775d3eea0a71b801a017b042aa0d7757b463bd510ee631"} Jun 03 19:29:55.426418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:55.426372 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-97lw7" podStartSLOduration=1.55719607 podStartE2EDuration="4.42635705s" totalImagesPullingTime="2.86916098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:55.425602638 +0000 UTC m=+38.819127545" watchObservedRunningTime="2026-06-03 19:29:55.42635705 +0000 UTC m=+38.819881957" Jun 03 19:29:56.418021 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:56.417979 2558 generic.go:356] "Generic (PLEG): container finished" podID="36d41982-7cb1-446a-a9ff-2466e9b810cb" containerID="7a294727ccb304091ad130e687de7a5fb38da61d7bc974c90bc2b323de6d1f1e" exitCode=0 Jun 03 19:29:56.418399 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:56.418055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerDied","Data":"7a294727ccb304091ad130e687de7a5fb38da61d7bc974c90bc2b323de6d1f1e"} Jun 03 19:29:57.423210 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:57.423175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" event={"ID":"36d41982-7cb1-446a-a9ff-2466e9b810cb","Type":"ContainerStarted","Data":"26e0e2d40ab4483cc70e9d19e2e55a61a2efd53ce5c90b23ff5007f3b8b44681"} Jun 03 19:29:57.448568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:57.448505 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r7tkx" podStartSLOduration=8.766391274 podStartE2EDuration="40.448488741s" totalImagesPullingTime="31.682097467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:57.447497969 +0000 UTC m=+40.841022914" watchObservedRunningTime="2026-06-03 19:29:57.448488741 +0000 UTC m=+40.842013648" Jun 03 19:29:57.568141 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:57.568099 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:57.624296 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:57.624257 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:29:59.267070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:59.267028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:29:59.267094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:59.267189 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:59.267218 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:59.267194 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:59.267290 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:07.267272702 +0000 UTC m=+50.660797588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:29:59.267467 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:29:59.267309 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:07.267300362 +0000 UTC m=+50.660825248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:30:03.293407 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:03.293365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:03.373142 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:03.373105 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:03.627276 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:03.627171 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:03.727789 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:03.727753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:04.557284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:04.557247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:04.615303 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:04.615272 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:07.330284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:07.330243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:07.330311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:07.330424 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:07.330427 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:07.330452 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:07.330480 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:23.330466233 +0000 UTC m=+66.723991119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:30:07.330750 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:07.330510 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:23.33049181 +0000 UTC m=+66.724016696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:30:08.289952 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:08.289910 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.376420 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.376377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.434573 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.434536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.521089 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.521056 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.591153 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.591127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.652372 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.652289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:15.756407 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:15.756377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.336060 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:16.336026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.395993 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:16.395968 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqb5x" Jun 03 19:30:16.399788 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:16.399760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.737213 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:16.737128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:16.805174 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:16.805148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.534744 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:17.534702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.591603 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:17.591557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.938764 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:17.938682 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:17.997070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:17.997036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.729308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:18.729273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:18.830990 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:18.830957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:19.148483 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:19.148447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:19.248973 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:19.248941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:20.560274 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.560243 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc"] Jun 03 19:30:20.563838 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.563814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.566079 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.566055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 19:30:20.566193 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.566058 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.566833 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.566814 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 19:30:20.566937 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.566879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.566937 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.566912 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tbm24\"" Jun 03 19:30:20.576438 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.576419 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc"] Jun 03 19:30:20.624671 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.624636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdld\" (UniqueName: \"kubernetes.io/projected/33aec51f-a9fd-49b2-b1a1-1ee28a964077-kube-api-access-fzdld\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.624792 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.624691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33aec51f-a9fd-49b2-b1a1-1ee28a964077-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.624792 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.624710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33aec51f-a9fd-49b2-b1a1-1ee28a964077-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.663271 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.663243 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6"] Jun 03 19:30:20.665271 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.665249 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-88876b98f-lhfhs"] Jun 03 19:30:20.665387 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.665371 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.667223 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.667206 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.668778 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.668751 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.669018 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.668997 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 19:30:20.669118 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.669000 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.669677 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.669654 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-92hm8\"" Jun 03 19:30:20.670887 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.670298 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 19:30:20.670887 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.670424 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 19:30:20.670887 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.670543 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 19:30:20.670887 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.670842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4v2bw\"" Jun 03 19:30:20.671174 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.670954 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 19:30:20.671842 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.671351 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 19:30:20.671842 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.671613 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.671842 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.671649 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.681612 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.681590 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6"] Jun 03 19:30:20.683720 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.683702 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-88876b98f-lhfhs"] Jun 03 19:30:20.725511 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-stats-auth\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.725676 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-serving-cert\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.725676 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcskp\" (UniqueName: \"kubernetes.io/projected/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-kube-api-access-mcskp\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.725676 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.725676 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdld\" (UniqueName: \"kubernetes.io/projected/33aec51f-a9fd-49b2-b1a1-1ee28a964077-kube-api-access-fzdld\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.725676 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-config\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.725829 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-default-certificate\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.725829 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.725829 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33aec51f-a9fd-49b2-b1a1-1ee28a964077-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.725955 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33aec51f-a9fd-49b2-b1a1-1ee28a964077-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.725955 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.725899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfgr\" (UniqueName: \"kubernetes.io/projected/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-kube-api-access-ntfgr\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.726386 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.726368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33aec51f-a9fd-49b2-b1a1-1ee28a964077-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.729215 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.729196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33aec51f-a9fd-49b2-b1a1-1ee28a964077-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.733329 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.733304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdld\" (UniqueName: \"kubernetes.io/projected/33aec51f-a9fd-49b2-b1a1-1ee28a964077-kube-api-access-fzdld\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc\" (UID: \"33aec51f-a9fd-49b2-b1a1-1ee28a964077\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.815239 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.815131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:20.827253 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-config\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.827358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-default-certificate\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.827358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.827358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfgr\" (UniqueName: \"kubernetes.io/projected/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-kube-api-access-ntfgr\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.827358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-stats-auth\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.827554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-serving-cert\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.827554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcskp\" (UniqueName: \"kubernetes.io/projected/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-kube-api-access-mcskp\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.827554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.827554 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:20.827399 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:20.827749 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:20.827586 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:21.327562841 +0000 UTC m=+64.721087726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:20.827818 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:20.827757 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:21.327739413 +0000 UTC m=+64.721264299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:20.827953 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.827935 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-config\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.829745 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.829712 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-serving-cert\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.829875 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.829781 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-stats-auth\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.829875 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.829796 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-default-certificate\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.836515 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.836495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfgr\" (UniqueName: \"kubernetes.io/projected/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-kube-api-access-ntfgr\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:20.836714 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.836697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcskp\" (UniqueName: \"kubernetes.io/projected/d2e6c2a1-d809-4b23-b1bd-6dbec1220080-kube-api-access-mcskp\") pod \"service-ca-operator-5bc4cf794b-5lwp6\" (UID: \"d2e6c2a1-d809-4b23-b1bd-6dbec1220080\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.872832 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.872807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" Jun 03 19:30:20.917562 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.917508 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:20.978296 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.978265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" Jun 03 19:30:20.991153 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:20.991126 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc"] Jun 03 19:30:20.994578 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:20.994544 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33aec51f_a9fd_49b2_b1a1_1ee28a964077.slice/crio-1f0bc5953af0a994c5d4d22018d4581da31b1c9833761af5406dff73a6a85a7f WatchSource:0}: Error finding container 1f0bc5953af0a994c5d4d22018d4581da31b1c9833761af5406dff73a6a85a7f: Status 404 returned error can't find the container with id 1f0bc5953af0a994c5d4d22018d4581da31b1c9833761af5406dff73a6a85a7f Jun 03 19:30:21.094749 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:21.094685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6"] Jun 03 19:30:21.097593 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:21.097567 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e6c2a1_d809_4b23_b1bd_6dbec1220080.slice/crio-15e1116262dbc7addc94fc78abe513575fdd85c7db4e5757468f742c3f166218 WatchSource:0}: Error finding container 15e1116262dbc7addc94fc78abe513575fdd85c7db4e5757468f742c3f166218: Status 404 returned error can't find the container with id 15e1116262dbc7addc94fc78abe513575fdd85c7db4e5757468f742c3f166218 Jun 03 19:30:21.331767 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:21.331738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:21.331940 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:21.331815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:21.331984 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:21.331942 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:21.331984 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:21.331947 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.331928527 +0000 UTC m=+65.725453430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:21.332061 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:21.331987 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.331977184 +0000 UTC m=+65.725502076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:21.478881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:21.478783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" event={"ID":"d2e6c2a1-d809-4b23-b1bd-6dbec1220080","Type":"ContainerStarted","Data":"15e1116262dbc7addc94fc78abe513575fdd85c7db4e5757468f742c3f166218"} Jun 03 19:30:21.479790 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:21.479762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" event={"ID":"33aec51f-a9fd-49b2-b1a1-1ee28a964077","Type":"ContainerStarted","Data":"1f0bc5953af0a994c5d4d22018d4581da31b1c9833761af5406dff73a6a85a7f"} Jun 03 19:30:22.339984 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.339950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:22.340387 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.340023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:22.340387 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:22.340119 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:22.340387 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:22.340182 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:24.340166746 +0000 UTC m=+67.733691633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:22.340387 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:22.340196 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:24.340190138 +0000 UTC m=+67.733715024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:22.528196 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.528154 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:22.583802 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.583767 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:22.843257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.843224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:30:22.845772 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.845751 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:30:22.856563 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.856540 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:30:22.866498 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.866473 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6w76\" (UniqueName: \"kubernetes.io/projected/88d0fd8c-5925-479f-b56d-b9bee2d4dd6a-kube-api-access-x6w76\") pod \"network-check-target-6hqpg\" (UID: \"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a\") " pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:30:22.943539 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.943506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:30:22.943677 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.943576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:30:22.946179 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.946160 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:30:22.946286 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.946191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:30:22.954222 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:22.954205 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:30:22.954281 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:22.954259 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs podName:b3800785-1ff3-45a4-8249-27ed1300a522 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:26.954245276 +0000 UTC m=+130.347770162 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs") pod "network-metrics-daemon-x2z9d" (UID: "b3800785-1ff3-45a4-8249-27ed1300a522") : secret "metrics-daemon-secret" not found Jun 03 19:30:22.956909 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:22.956881 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acd494d0-55f8-4f38-8c26-1ce04f072b0a-original-pull-secret\") pod \"global-pull-secret-syncer-zm2zr\" (UID: \"acd494d0-55f8-4f38-8c26-1ce04f072b0a\") " pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:30:23.119982 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.119900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zm2zr" Jun 03 19:30:23.135548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.135522 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvcxn\"" Jun 03 19:30:23.143788 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.143753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:30:23.347739 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.347700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.347801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:23.347869 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:23.347944 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls podName:adc0d0c5-cdfe-4312-8ca0-101a64635ca7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:55.347924705 +0000 UTC m=+98.741449611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls") pod "dns-default-l8r76" (UID: "adc0d0c5-cdfe-4312-8ca0-101a64635ca7") : secret "dns-default-metrics-tls" not found Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:23.347982 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:23.348003 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dfddf4bd-rzwpz: secret "image-registry-tls" not found Jun 03 19:30:23.348205 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:23.348062 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls podName:1160a6a2-5429-4307-800e-2a2b8e884081 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:55.348046424 +0000 UTC m=+98.741571313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls") pod "image-registry-64dfddf4bd-rzwpz" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081") : secret "image-registry-tls" not found Jun 03 19:30:23.619680 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.619639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:23.677693 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:23.677607 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:24.354095 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.354040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:24.354437 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.354115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:24.354437 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:24.354212 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:28.35419292 +0000 UTC m=+71.747717813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:24.354437 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:24.354227 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:24.354437 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:24.354263 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:28.35425247 +0000 UTC m=+71.747777357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:24.481324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.479531 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zm2zr"] Jun 03 19:30:24.487220 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:24.486890 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd494d0_55f8_4f38_8c26_1ce04f072b0a.slice/crio-9bda0114be05076f1f14a5cbaa3fc281a65def5bb4dc6ada3e9bcfc0e1f798d5 WatchSource:0}: Error finding container 9bda0114be05076f1f14a5cbaa3fc281a65def5bb4dc6ada3e9bcfc0e1f798d5: Status 404 returned error can't find the container with id 9bda0114be05076f1f14a5cbaa3fc281a65def5bb4dc6ada3e9bcfc0e1f798d5 Jun 03 19:30:24.489845 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.489794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" event={"ID":"d2e6c2a1-d809-4b23-b1bd-6dbec1220080","Type":"ContainerStarted","Data":"ed1d9c399781be66dcc12d92f743110300baee169cb7660e5533161d3fd6e296"} Jun 03 19:30:24.491468 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.491444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" event={"ID":"33aec51f-a9fd-49b2-b1a1-1ee28a964077","Type":"ContainerStarted","Data":"821b0590addb2a331287d47556e3346299cfc8cefa647dd457c9f7308f19b5fe"} Jun 03 19:30:24.507557 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.507534 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6hqpg"] Jun 03 19:30:24.511878 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:24.511829 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d0fd8c_5925_479f_b56d_b9bee2d4dd6a.slice/crio-c5a9bd3fb0d2c468b9915e64229ef79d2767db4c5c737a84f05a9b5835865ce8 WatchSource:0}: Error finding container c5a9bd3fb0d2c468b9915e64229ef79d2767db4c5c737a84f05a9b5835865ce8: Status 404 returned error can't find the container with id c5a9bd3fb0d2c468b9915e64229ef79d2767db4c5c737a84f05a9b5835865ce8 Jun 03 19:30:24.526939 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.526880 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" podStartSLOduration=1.275532396 podStartE2EDuration="4.526845177s" totalImagesPullingTime="3.251312781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:24.526375157 +0000 UTC m=+67.919900078" watchObservedRunningTime="2026-06-03 19:30:24.526845177 +0000 UTC m=+67.920370062" Jun 03 19:30:24.548250 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:24.548207 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" podStartSLOduration=1.188715743 podStartE2EDuration="4.548193506s" totalImagesPullingTime="3.359477763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:24.547622167 +0000 UTC m=+67.941147077" watchObservedRunningTime="2026-06-03 19:30:24.548193506 +0000 UTC m=+67.941718414" Jun 03 19:30:25.496569 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.496533 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6hqpg" event={"ID":"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a","Type":"ContainerStarted","Data":"c5a9bd3fb0d2c468b9915e64229ef79d2767db4c5c737a84f05a9b5835865ce8"} Jun 03 19:30:25.497870 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.497827 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zm2zr" event={"ID":"acd494d0-55f8-4f38-8c26-1ce04f072b0a","Type":"ContainerStarted","Data":"9bda0114be05076f1f14a5cbaa3fc281a65def5bb4dc6ada3e9bcfc0e1f798d5"} Jun 03 19:30:25.597877 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.597373 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6"] Jun 03 19:30:25.619654 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.619621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6"] Jun 03 19:30:25.619810 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.619736 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" Jun 03 19:30:25.622814 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.622793 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hdtxl\"" Jun 03 19:30:25.666445 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.666412 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrzv\" (UniqueName: \"kubernetes.io/projected/add509fb-ad61-4866-85c1-c93c7277143d-kube-api-access-pvrzv\") pod \"network-check-source-dbd9cf844-mkjv6\" (UID: \"add509fb-ad61-4866-85c1-c93c7277143d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" Jun 03 19:30:25.767556 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.767520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrzv\" (UniqueName: \"kubernetes.io/projected/add509fb-ad61-4866-85c1-c93c7277143d-kube-api-access-pvrzv\") pod \"network-check-source-dbd9cf844-mkjv6\" (UID: \"add509fb-ad61-4866-85c1-c93c7277143d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" Jun 03 19:30:25.777688 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.777640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrzv\" (UniqueName: \"kubernetes.io/projected/add509fb-ad61-4866-85c1-c93c7277143d-kube-api-access-pvrzv\") pod \"network-check-source-dbd9cf844-mkjv6\" (UID: \"add509fb-ad61-4866-85c1-c93c7277143d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" Jun 03 19:30:25.933442 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:25.933397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" Jun 03 19:30:26.104905 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.104773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6"] Jun 03 19:30:26.108930 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:26.108901 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd509fb_ad61_4866_85c1_c93c7277143d.slice/crio-f96b894ac41ad6b8a9ab572aef64deb6f086e04ab73ad80e5df0c0d6966647c6 WatchSource:0}: Error finding container f96b894ac41ad6b8a9ab572aef64deb6f086e04ab73ad80e5df0c0d6966647c6: Status 404 returned error can't find the container with id f96b894ac41ad6b8a9ab572aef64deb6f086e04ab73ad80e5df0c0d6966647c6 Jun 03 19:30:26.429827 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.429741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:26.487521 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.487425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:26.503160 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.503057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" event={"ID":"add509fb-ad61-4866-85c1-c93c7277143d","Type":"ContainerStarted","Data":"f96b894ac41ad6b8a9ab572aef64deb6f086e04ab73ad80e5df0c0d6966647c6"} Jun 03 19:30:26.703836 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.703662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:26.764659 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.764609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:26.875461 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.875350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:26.976507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:26.976376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.127640 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.127607 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.230396 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.230317 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.364887 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.364756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.384408 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.384239 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz"] Jun 03 19:30:27.393575 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.393284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" Jun 03 19:30:27.394411 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.394356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz"] Jun 03 19:30:27.396374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.395770 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lq7pn\"" Jun 03 19:30:27.396374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.396105 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:27.396963 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.396925 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 19:30:27.465977 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.465912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.485237 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.485157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r796\" (UniqueName: \"kubernetes.io/projected/10fc038f-1bf1-4253-9bf8-2a39f54dc64b-kube-api-access-6r796\") pod \"migrator-955ffdf5f-f86mz\" (UID: \"10fc038f-1bf1-4253-9bf8-2a39f54dc64b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" Jun 03 19:30:27.564634 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.564575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:27.585756 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.585727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r796\" (UniqueName: \"kubernetes.io/projected/10fc038f-1bf1-4253-9bf8-2a39f54dc64b-kube-api-access-6r796\") pod \"migrator-955ffdf5f-f86mz\" (UID: \"10fc038f-1bf1-4253-9bf8-2a39f54dc64b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" Jun 03 19:30:27.595456 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.595427 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r796\" (UniqueName: \"kubernetes.io/projected/10fc038f-1bf1-4253-9bf8-2a39f54dc64b-kube-api-access-6r796\") pod \"migrator-955ffdf5f-f86mz\" (UID: \"10fc038f-1bf1-4253-9bf8-2a39f54dc64b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" Jun 03 19:30:27.706829 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:27.706724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" Jun 03 19:30:28.393011 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:28.392964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:28.393159 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:28.393093 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:28.393159 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:28.393120 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:28.393253 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:28.393182 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:36.393166689 +0000 UTC m=+79.786691575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:28.393299 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:28.393249 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:36.393235093 +0000 UTC m=+79.786759978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:28.411039 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:28.411010 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bptc6_b21ddd88-5737-45b4-a4e6-caff70db04ee/dns-node-resolver/0.log" Jun 03 19:30:28.773224 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:28.773183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:28.840267 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:28.840236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:29.011349 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:29.011322 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zshw_9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4/node-ca/0.log" Jun 03 19:30:29.648394 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:29.648326 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:29.819690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:29.819670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-97lw7_eb9298ab-5021-46a3-85a4-bfb516910a53/serve-healthcheck-canary/0.log" Jun 03 19:30:29.938235 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:29.938206 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz"] Jun 03 19:30:29.942268 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:29.942232 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fc038f_1bf1_4253_9bf8_2a39f54dc64b.slice/crio-3df44fdfb8c40c59cedfad0a4963e441a97d45d845e37e8aef187117b4b85b09 WatchSource:0}: Error finding container 3df44fdfb8c40c59cedfad0a4963e441a97d45d845e37e8aef187117b4b85b09: Status 404 returned error can't find the container with id 3df44fdfb8c40c59cedfad0a4963e441a97d45d845e37e8aef187117b4b85b09 Jun 03 19:30:30.517182 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.517144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6hqpg" event={"ID":"88d0fd8c-5925-479f-b56d-b9bee2d4dd6a","Type":"ContainerStarted","Data":"29ce681b27da1a92cb040d82b65829d79275373a3254c1d63f9dd0966a189a06"} Jun 03 19:30:30.517374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.517258 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:30:30.518824 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.518797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zm2zr" event={"ID":"acd494d0-55f8-4f38-8c26-1ce04f072b0a","Type":"ContainerStarted","Data":"8801359b2e82a4a14c798d1838cc1c04657214910070b29eb6473403233f68b2"} Jun 03 19:30:30.520109 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.520090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" event={"ID":"10fc038f-1bf1-4253-9bf8-2a39f54dc64b","Type":"ContainerStarted","Data":"3df44fdfb8c40c59cedfad0a4963e441a97d45d845e37e8aef187117b4b85b09"} Jun 03 19:30:30.521660 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.521635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" event={"ID":"add509fb-ad61-4866-85c1-c93c7277143d","Type":"ContainerStarted","Data":"ca62c1b06e13f0a4cdddf3ccfcc03d19d655305b9601a98b2fa79b839565cb1b"} Jun 03 19:30:30.535797 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.535759 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6hqpg" podStartSLOduration=68.252611339 podStartE2EDuration="1m13.535748262s" totalImagesPullingTime="5.283136923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:30.533980139 +0000 UTC m=+73.927505048" watchObservedRunningTime="2026-06-03 19:30:30.535748262 +0000 UTC m=+73.929273169" Jun 03 19:30:30.549403 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.549142 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zm2zr" podStartSLOduration=68.234759276 podStartE2EDuration="1m13.549126254s" totalImagesPullingTime="5.314366978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:30.548977701 +0000 UTC m=+73.942502610" watchObservedRunningTime="2026-06-03 19:30:30.549126254 +0000 UTC m=+73.942651173" Jun 03 19:30:30.565730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:30.565686 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mkjv6" podStartSLOduration=1.8676875640000001 podStartE2EDuration="5.565671889s" totalImagesPullingTime="3.697984325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:30.564778582 +0000 UTC m=+73.958303490" watchObservedRunningTime="2026-06-03 19:30:30.565671889 +0000 UTC m=+73.959196797" Jun 03 19:30:31.526412 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:31.526375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" event={"ID":"10fc038f-1bf1-4253-9bf8-2a39f54dc64b","Type":"ContainerStarted","Data":"069714a26bf97a4b6f35bcb849c70f4a2714b515b4507d26442a8b9267cadd5c"} Jun 03 19:30:31.526927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:31.526443 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" event={"ID":"10fc038f-1bf1-4253-9bf8-2a39f54dc64b","Type":"ContainerStarted","Data":"2287984ae3cd032049f5b8dd5690e2a638557b91cfa5c0380aad4777ae357514"} Jun 03 19:30:31.543288 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:31.543247 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-f86mz" podStartSLOduration=3.482474691 podStartE2EDuration="4.543233258s" totalImagesPullingTime="1.060758567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:31.541913732 +0000 UTC m=+74.935438640" watchObservedRunningTime="2026-06-03 19:30:31.543233258 +0000 UTC m=+74.936758165" Jun 03 19:30:32.806070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:32.806035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:33.376648 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:33.376613 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:33.574642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:33.574599 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:33.682594 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:33.682514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:33.989885 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:33.989755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:34.089142 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:34.089104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:34.190938 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:34.190898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:34.459900 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:34.459867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:35.262464 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:35.262427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:35.662010 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:35.661922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:36.061605 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.061578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:36.269672 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.269639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:36.340598 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.340456 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:36.404398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.404363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:36.456563 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.456535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:36.456658 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.456589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:36.456720 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:36.456705 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.456687107 +0000 UTC m=+95.850211992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : configmap references non-existent config key: service-ca.crt Jun 03 19:30:36.456768 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:36.456712 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:30:36.456768 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:30:36.456743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs podName:fe22cf6d-5f7e-4459-9adb-c8ee293848f4 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.456736823 +0000 UTC m=+95.850261709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs") pod "router-default-88876b98f-lhfhs" (UID: "fe22cf6d-5f7e-4459-9adb-c8ee293848f4") : secret "router-metrics-certs-default" not found Jun 03 19:30:36.657490 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:36.657404 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.066502 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:37.066456 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.207503 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:37.207472 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.277306 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:37.277274 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:37.861637 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:37.861604 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.062464 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:38.062429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.166135 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:38.166038 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.267991 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:38.267963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:38.462415 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:38.462327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:39.264593 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:39.264547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:39.591279 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:39.591196 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:39.692288 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:39.692255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:39.794154 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:39.794124 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:40.062358 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:40.062323 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:40.267867 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:40.267815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:40.661443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:40.661408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:41.254096 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:41.254062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:41.471085 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:41.471047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:41.861867 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:41.861822 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:42.060172 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:42.060139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:42.266300 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:42.266270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:42.468036 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:42.468008 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.459255 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:43.459218 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.662904 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:43.662872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:43.858054 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:43.858025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:44.061171 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:44.061133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.034564 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.034529 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.135289 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.135248 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.239149 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.239118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.531628 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.531598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.702131 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.702096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.759696 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.759668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.906160 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.906081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:47.967192 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:47.967149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:48.295771 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:48.295742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:48.500284 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:48.500256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:48.915762 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:48.915724 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.525175 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:49.525144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.598737 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:49.598701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:49.919147 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:49.919048 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.262883 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.262836 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6"] Jun 03 19:30:52.267243 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.267226 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.269818 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.269795 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:30:52.269949 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.269835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:30:52.270029 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.269962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 19:30:52.271876 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.271230 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 19:30:52.271876 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.271347 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 19:30:52.271876 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.271380 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 19:30:52.272087 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.271892 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:30:52.283037 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.283008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6"] Jun 03 19:30:52.362111 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.362081 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gcdg8"] Jun 03 19:30:52.365205 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.365177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.368162 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.368142 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9gpp5\"" Jun 03 19:30:52.368265 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.368181 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:30:52.368265 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.368212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:30:52.372537 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.372522 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:30:52.372997 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.372983 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:30:52.376753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.376837 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.376837 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.376964 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a00575-3faf-4a5c-a665-97a741ce01d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.376964 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376927 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqkrb\" (UniqueName: \"kubernetes.io/projected/36a00575-3faf-4a5c-a665-97a741ce01d3-kube-api-access-xqkrb\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.377047 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.376978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.386741 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.386721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.434388 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.434366 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcdg8"] Jun 03 19:30:52.477939 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.477917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.477947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a00575-3faf-4a5c-a665-97a741ce01d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.477965 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqkrb\" (UniqueName: \"kubernetes.io/projected/36a00575-3faf-4a5c-a665-97a741ce01d3-kube-api-access-xqkrb\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-data-volume\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.478065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.478308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:52.478308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-crio-socket\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.478308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8f2\" (UniqueName: \"kubernetes.io/projected/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-api-access-7x8f2\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.478308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478308 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.478559 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.478559 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:52.478832 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.478808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a00575-3faf-4a5c-a665-97a741ce01d3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.479145 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.479124 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-service-ca-bundle\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:52.480796 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.480769 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe22cf6d-5f7e-4459-9adb-c8ee293848f4-metrics-certs\") pod \"router-default-88876b98f-lhfhs\" (UID: \"fe22cf6d-5f7e-4459-9adb-c8ee293848f4\") " pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:52.481013 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.480995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-ca\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.481075 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.481018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.481075 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.481065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.481143 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.481123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36a00575-3faf-4a5c-a665-97a741ce01d3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.483903 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.483882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:52.498719 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.498696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqkrb\" (UniqueName: \"kubernetes.io/projected/36a00575-3faf-4a5c-a665-97a741ce01d3-kube-api-access-xqkrb\") pod \"cluster-proxy-proxy-agent-c67798f46-whnn6\" (UID: \"36a00575-3faf-4a5c-a665-97a741ce01d3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.502219 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.502178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.579305 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-data-volume\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-crio-socket\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579432 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8f2\" (UniqueName: \"kubernetes.io/projected/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-api-access-7x8f2\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579599 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-crio-socket\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579599 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.579797 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.579774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-data-volume\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.580074 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.580050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.581669 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.581647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.588107 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.588088 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8f2\" (UniqueName: \"kubernetes.io/projected/18118ef0-6c8c-4c45-a0ae-16ad6bceea89-kube-api-access-7x8f2\") pod \"insights-runtime-extractor-gcdg8\" (UID: \"18118ef0-6c8c-4c45-a0ae-16ad6bceea89\") " pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.593511 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.593487 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.596299 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.596279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" Jun 03 19:30:52.609303 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.609284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-88876b98f-lhfhs"] Jun 03 19:30:52.612260 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:52.612238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe22cf6d_5f7e_4459_9adb_c8ee293848f4.slice/crio-4b7a4efe6c7c3af07b9155ff94225df4ea277d4b114b981fc2159791ef174712 WatchSource:0}: Error finding container 4b7a4efe6c7c3af07b9155ff94225df4ea277d4b114b981fc2159791ef174712: Status 404 returned error can't find the container with id 4b7a4efe6c7c3af07b9155ff94225df4ea277d4b114b981fc2159791ef174712 Jun 03 19:30:52.674076 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.673666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcdg8" Jun 03 19:30:52.720774 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.720713 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.760706 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.760673 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6"] Jun 03 19:30:52.763370 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:52.763339 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a00575_3faf_4a5c_a665_97a741ce01d3.slice/crio-10b6e0eeb73b72150e851c1e8f1dd1e58cd3333c87306c794438c78e7da88440 WatchSource:0}: Error finding container 10b6e0eeb73b72150e851c1e8f1dd1e58cd3333c87306c794438c78e7da88440: Status 404 returned error can't find the container with id 10b6e0eeb73b72150e851c1e8f1dd1e58cd3333c87306c794438c78e7da88440 Jun 03 19:30:52.806978 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.806916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcdg8"] Jun 03 19:30:52.808156 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:52.808102 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:52.810112 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:52.810092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18118ef0_6c8c_4c45_a0ae_16ad6bceea89.slice/crio-3e0b47b9691abdb7eb8699c9146208920bcced5f67f7cbde93998caf338a73fb WatchSource:0}: Error finding container 3e0b47b9691abdb7eb8699c9146208920bcced5f67f7cbde93998caf338a73fb: Status 404 returned error can't find the container with id 3e0b47b9691abdb7eb8699c9146208920bcced5f67f7cbde93998caf338a73fb Jun 03 19:30:53.449102 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.449068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:53.548782 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.548748 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:53.590113 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.590083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcdg8" event={"ID":"18118ef0-6c8c-4c45-a0ae-16ad6bceea89","Type":"ContainerStarted","Data":"92df552401bfcf1c5c7fd7ff0713efddd0cc22f8556988c5e4c0b78e86bff2be"} Jun 03 19:30:53.590223 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.590145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcdg8" event={"ID":"18118ef0-6c8c-4c45-a0ae-16ad6bceea89","Type":"ContainerStarted","Data":"2766ebc3a549d101f9ac378c9827d4b2aefcb35feab76e7f0b5a180c1b451dce"} Jun 03 19:30:53.590223 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.590179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcdg8" event={"ID":"18118ef0-6c8c-4c45-a0ae-16ad6bceea89","Type":"ContainerStarted","Data":"3e0b47b9691abdb7eb8699c9146208920bcced5f67f7cbde93998caf338a73fb"} Jun 03 19:30:53.591192 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.591168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" event={"ID":"36a00575-3faf-4a5c-a665-97a741ce01d3","Type":"ContainerStarted","Data":"10b6e0eeb73b72150e851c1e8f1dd1e58cd3333c87306c794438c78e7da88440"} Jun 03 19:30:53.592518 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.592498 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-88876b98f-lhfhs" event={"ID":"fe22cf6d-5f7e-4459-9adb-c8ee293848f4","Type":"ContainerStarted","Data":"c95ce8f919de5a4fa47d5dc210d9efa74404dae35afaf58407050ba95e19e911"} Jun 03 19:30:53.592599 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.592537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-88876b98f-lhfhs" event={"ID":"fe22cf6d-5f7e-4459-9adb-c8ee293848f4","Type":"ContainerStarted","Data":"4b7a4efe6c7c3af07b9155ff94225df4ea277d4b114b981fc2159791ef174712"} Jun 03 19:30:53.612369 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.612326 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-88876b98f-lhfhs" podStartSLOduration=33.612310552 podStartE2EDuration="33.612310552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.6109017 +0000 UTC m=+97.004426605" watchObservedRunningTime="2026-06-03 19:30:53.612310552 +0000 UTC m=+97.005835460" Jun 03 19:30:53.730237 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.730156 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:53.794580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:53.794499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:54.484913 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:54.484813 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:54.488479 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:54.488277 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:54.600014 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:54.599938 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:54.601615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:54.601430 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-88876b98f-lhfhs" Jun 03 19:30:55.403046 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.403007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:55.403223 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.403064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:55.405612 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.405584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc0d0c5-cdfe-4312-8ca0-101a64635ca7-metrics-tls\") pod \"dns-default-l8r76\" (UID: \"adc0d0c5-cdfe-4312-8ca0-101a64635ca7\") " pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:55.405736 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.405697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"image-registry-64dfddf4bd-rzwpz\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:55.665258 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.665178 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djr9z\"" Jun 03 19:30:55.673243 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.673216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:55.680787 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.680758 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gklzb\"" Jun 03 19:30:55.688653 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.688629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:55.842305 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.842265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:55.905176 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:55.905140 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:57.090793 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.090766 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8r76"] Jun 03 19:30:57.105972 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:57.105949 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc0d0c5_cdfe_4312_8ca0_101a64635ca7.slice/crio-54424873449a13a33058e7fca79ee693c56b5540fecb83695620fea5a6e9aedb WatchSource:0}: Error finding container 54424873449a13a33058e7fca79ee693c56b5540fecb83695620fea5a6e9aedb: Status 404 returned error can't find the container with id 54424873449a13a33058e7fca79ee693c56b5540fecb83695620fea5a6e9aedb Jun 03 19:30:57.110684 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.110622 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:30:57.113637 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:30:57.113608 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1160a6a2_5429_4307_800e_2a2b8e884081.slice/crio-3efe3b617c4c32d2210601aba5cb32f7049281b160c6300c411b234dd22d7979 WatchSource:0}: Error finding container 3efe3b617c4c32d2210601aba5cb32f7049281b160c6300c411b234dd22d7979: Status 404 returned error can't find the container with id 3efe3b617c4c32d2210601aba5cb32f7049281b160c6300c411b234dd22d7979 Jun 03 19:30:57.613711 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.613671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcdg8" event={"ID":"18118ef0-6c8c-4c45-a0ae-16ad6bceea89","Type":"ContainerStarted","Data":"9597a85f05867d3f9d343ace8204b398a87ed214e0b34a1be3589d3a573f773a"} Jun 03 19:30:57.616309 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.616275 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" event={"ID":"36a00575-3faf-4a5c-a665-97a741ce01d3","Type":"ContainerStarted","Data":"f9704c6acffd298cebc6d1861145549ea4e95fac3914e34e7b09a6e8d681b7d8"} Jun 03 19:30:57.616443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.616329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" event={"ID":"36a00575-3faf-4a5c-a665-97a741ce01d3","Type":"ContainerStarted","Data":"4b609c5b88197cbbfc86c524cba7112aa36d5e1a6a7ddbd2c797e0ac085d1695"} Jun 03 19:30:57.616443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.616349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" event={"ID":"36a00575-3faf-4a5c-a665-97a741ce01d3","Type":"ContainerStarted","Data":"ac01d537ab238ccdc768e93f7e2ee22ab1ab742b2c14968b9cd7a47485c830f0"} Jun 03 19:30:57.618011 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.617986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" event={"ID":"1160a6a2-5429-4307-800e-2a2b8e884081","Type":"ContainerStarted","Data":"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c"} Jun 03 19:30:57.618129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.618031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" event={"ID":"1160a6a2-5429-4307-800e-2a2b8e884081","Type":"ContainerStarted","Data":"3efe3b617c4c32d2210601aba5cb32f7049281b160c6300c411b234dd22d7979"} Jun 03 19:30:57.618129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.618091 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:30:57.624727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.624694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8r76" event={"ID":"adc0d0c5-cdfe-4312-8ca0-101a64635ca7","Type":"ContainerStarted","Data":"54424873449a13a33058e7fca79ee693c56b5540fecb83695620fea5a6e9aedb"} Jun 03 19:30:57.656260 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.655748 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gcdg8" podStartSLOduration=1.6712762909999999 podStartE2EDuration="5.655729085s" totalImagesPullingTime="3.984452794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.653464111 +0000 UTC m=+101.046989019" watchObservedRunningTime="2026-06-03 19:30:57.655729085 +0000 UTC m=+101.049253991" Jun 03 19:30:57.688804 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.688758 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" podStartSLOduration=100.688741156 podStartE2EDuration="1m40.688741156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.687387091 +0000 UTC m=+101.080912001" watchObservedRunningTime="2026-06-03 19:30:57.688741156 +0000 UTC m=+101.082266064" Jun 03 19:30:57.714331 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.714283 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c67798f46-whnn6" podStartSLOduration=1.537980414 podStartE2EDuration="5.714269135s" totalImagesPullingTime="4.176288721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.713489496 +0000 UTC m=+101.107014404" watchObservedRunningTime="2026-06-03 19:30:57.714269135 +0000 UTC m=+101.107794021" Jun 03 19:30:57.820836 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.820791 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:57.871678 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:57.871578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:30:59.633430 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:59.633399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8r76" event={"ID":"adc0d0c5-cdfe-4312-8ca0-101a64635ca7","Type":"ContainerStarted","Data":"4c103cdc13ceddd59ad5a0056fc8570866d3fda8b96a187344a5e0fc362c23f7"} Jun 03 19:30:59.633791 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:59.633448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8r76" event={"ID":"adc0d0c5-cdfe-4312-8ca0-101a64635ca7","Type":"ContainerStarted","Data":"40b49539b40365624bb3d1315708ff5d967b8f03896a1bca65f67598cf17c4f4"} Jun 03 19:30:59.633791 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:59.633524 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l8r76" Jun 03 19:30:59.651669 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:30:59.651629 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l8r76" podStartSLOduration=66.594907858 podStartE2EDuration="1m8.651615978s" totalImagesPullingTime="2.05670812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:59.650138545 +0000 UTC m=+103.043663452" watchObservedRunningTime="2026-06-03 19:30:59.651615978 +0000 UTC m=+103.045140893" Jun 03 19:31:00.148555 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:00.148516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:00.212493 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:00.212464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:01.471943 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:01.471907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:01.529065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:01.529037 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6hqpg" Jun 03 19:31:01.557061 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:01.557032 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:01.659013 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:01.658976 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:02.324636 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:02.320797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:04.345185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:04.345146 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:04.400499 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:04.400469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:06.696410 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:06.696378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:06.800775 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:06.800744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:06.898999 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:06.898971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:08.145787 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:08.145748 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:08.214975 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:08.214936 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:09.270656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:09.270601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:09.638669 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:09.638589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l8r76" Jun 03 19:31:09.788418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:09.788386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:09.892971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:09.892886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.208028 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:10.207943 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.274024 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:10.273994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.862738 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:10.862699 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.988804 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:10.988775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.150328 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.150240 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.229721 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.229692 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fw2kx"] Jun 03 19:31:11.232924 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.232909 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.236152 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.236132 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:31:11.236307 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.236286 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:31:11.236481 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.236465 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97z8f\"" Jun 03 19:31:11.236546 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.236517 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:31:11.237184 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.237166 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:31:11.237526 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.237509 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:31:11.237569 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.237515 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:31:11.270477 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.270454 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.325455 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-metrics-client-ca\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-root\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkwh\" (UniqueName: \"kubernetes.io/projected/25d604d2-4f9e-4f9f-a331-4ff799d678ab-kube-api-access-clkwh\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325593 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-textfile\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-sys\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.325769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.325645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-wtmp\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.362418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.362379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.426429 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-textfile\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426429 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-sys\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-sys\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-wtmp\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-metrics-client-ca\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-root\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clkwh\" (UniqueName: \"kubernetes.io/projected/25d604d2-4f9e-4f9f-a331-4ff799d678ab-kube-api-access-clkwh\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.426665 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-root\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.427128 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:31:11.426665 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 19:31:11.427128 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.426686 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-wtmp\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.427128 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:31:11.426784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls podName:25d604d2-4f9e-4f9f-a331-4ff799d678ab nodeName:}" failed. No retries permitted until 2026-06-03 19:31:11.926759747 +0000 UTC m=+115.320284633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls") pod "node-exporter-fw2kx" (UID: "25d604d2-4f9e-4f9f-a331-4ff799d678ab") : secret "node-exporter-tls" not found Jun 03 19:31:11.427263 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.427169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-metrics-client-ca\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.427263 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.427174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.427263 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.427172 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-textfile\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.428794 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.428778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.441182 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.441156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkwh\" (UniqueName: \"kubernetes.io/projected/25d604d2-4f9e-4f9f-a331-4ff799d678ab-kube-api-access-clkwh\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.469470 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.469433 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.577587 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.577553 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.791197 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.791161 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.892045 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.892003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:11.930811 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.930772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:11.933187 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:11.933164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25d604d2-4f9e-4f9f-a331-4ff799d678ab-node-exporter-tls\") pod \"node-exporter-fw2kx\" (UID: \"25d604d2-4f9e-4f9f-a331-4ff799d678ab\") " pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:12.100234 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:12.100137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:12.142333 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:12.142300 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fw2kx" Jun 03 19:31:12.153226 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:31:12.153193 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d604d2_4f9e_4f9f_a331_4ff799d678ab.slice/crio-b2d38e61fd2740e425d60a9ff920d989ef3d4bb6e4553e267b518568df6669cf WatchSource:0}: Error finding container b2d38e61fd2740e425d60a9ff920d989ef3d4bb6e4553e267b518568df6669cf: Status 404 returned error can't find the container with id b2d38e61fd2740e425d60a9ff920d989ef3d4bb6e4553e267b518568df6669cf Jun 03 19:31:12.175220 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:12.175185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:12.296452 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:12.296418 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:12.676839 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:12.676798 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fw2kx" event={"ID":"25d604d2-4f9e-4f9f-a331-4ff799d678ab","Type":"ContainerStarted","Data":"b2d38e61fd2740e425d60a9ff920d989ef3d4bb6e4553e267b518568df6669cf"} Jun 03 19:31:13.681820 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:13.681785 2558 generic.go:356] "Generic (PLEG): container finished" podID="25d604d2-4f9e-4f9f-a331-4ff799d678ab" containerID="70508d77df13288dfc1e59538983745aab28f7e663eed60e085ec35a15e796f3" exitCode=0 Jun 03 19:31:13.682214 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:13.681835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fw2kx" event={"ID":"25d604d2-4f9e-4f9f-a331-4ff799d678ab","Type":"ContainerDied","Data":"70508d77df13288dfc1e59538983745aab28f7e663eed60e085ec35a15e796f3"} Jun 03 19:31:14.065914 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.065878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.169173 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.169138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.689518 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.689480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fw2kx" event={"ID":"25d604d2-4f9e-4f9f-a331-4ff799d678ab","Type":"ContainerStarted","Data":"e16d542bff0b974494307530bbe8a363e137e33092a6976756cf87303c1b53bd"} Jun 03 19:31:14.689899 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.689530 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fw2kx" event={"ID":"25d604d2-4f9e-4f9f-a331-4ff799d678ab","Type":"ContainerStarted","Data":"727870dfe50d2c054a7312736d51d02f14675186a0b071665e5289a6983481f9"} Jun 03 19:31:14.710101 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.710055 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fw2kx" podStartSLOduration=2.764660093 podStartE2EDuration="3.710040962s" totalImagesPullingTime="877.350117ms" totalInitContainerRuntime="68.030752ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:14.709117163 +0000 UTC m=+118.102642070" watchObservedRunningTime="2026-06-03 19:31:14.710040962 +0000 UTC m=+118.103565870" Jun 03 19:31:14.823593 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.823558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.923441 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:14.923406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:15.405507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:15.405474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:15.475052 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:15.475019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:15.881596 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:15.881557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:15.953191 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:15.953145 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:16.451600 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:16.451570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:16.761509 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:16.761480 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:31:16.765945 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:16.765923 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:31:16.847883 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:16.847843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:16.948485 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:16.948458 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:17.049124 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:17.049042 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:17.417969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:17.417881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:18.403654 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:18.403614 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:18.469178 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:18.469147 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:18.820686 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:18.820653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:18.920294 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:18.920259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:20.353073 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:20.353036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:20.408195 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:20.408165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:22.459761 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:22.459722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:22.533445 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:22.533416 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:22.594776 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:22.594745 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:23.092041 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:23.092004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:23.149004 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:23.148974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:24.123352 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:24.123321 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:24.174024 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:24.173993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:24.620837 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:24.620777 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:24.681612 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:24.681575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:27.039064 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.039022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:31:27.041312 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.041280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3800785-1ff3-45a4-8249-27ed1300a522-metrics-certs\") pod \"network-metrics-daemon-x2z9d\" (UID: \"b3800785-1ff3-45a4-8249-27ed1300a522\") " pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:31:27.328945 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.328863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tx4t\"" Jun 03 19:31:27.336841 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.336824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x2z9d" Jun 03 19:31:27.463679 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.463650 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x2z9d"] Jun 03 19:31:27.466575 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:31:27.466549 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3800785_1ff3_45a4_8249_27ed1300a522.slice/crio-c31d9d9e73821e2f2c2c7a07443f2aa7145cf57458c9b94ef045aca3325647ab WatchSource:0}: Error finding container c31d9d9e73821e2f2c2c7a07443f2aa7145cf57458c9b94ef045aca3325647ab: Status 404 returned error can't find the container with id c31d9d9e73821e2f2c2c7a07443f2aa7145cf57458c9b94ef045aca3325647ab Jun 03 19:31:27.731414 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.731346 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2z9d" event={"ID":"b3800785-1ff3-45a4-8249-27ed1300a522","Type":"ContainerStarted","Data":"c31d9d9e73821e2f2c2c7a07443f2aa7145cf57458c9b94ef045aca3325647ab"} Jun 03 19:31:27.836997 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.836827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:27.937290 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:27.937255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:28.736384 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:28.736294 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2z9d" event={"ID":"b3800785-1ff3-45a4-8249-27ed1300a522","Type":"ContainerStarted","Data":"2c2ff0bcdc896595508bc2529714b7385446a5cc19399efda1307a81f37be96f"} Jun 03 19:31:28.736384 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:28.736351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x2z9d" event={"ID":"b3800785-1ff3-45a4-8249-27ed1300a522","Type":"ContainerStarted","Data":"b03a5c23f8f1498103308ab79eab9588fbdf8efe4828df43e5f3ae92db9f175c"} Jun 03 19:31:28.754237 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:28.754196 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x2z9d" podStartSLOduration=130.865649511 podStartE2EDuration="2m11.754181135s" totalImagesPullingTime="888.531624ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:28.753071877 +0000 UTC m=+132.146596789" watchObservedRunningTime="2026-06-03 19:31:28.754181135 +0000 UTC m=+132.147706042" Jun 03 19:31:28.858001 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:28.857971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:28.958974 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:28.958930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:31.651379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:31.651342 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:31.754708 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:31.754677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:33.291838 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:33.291788 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:33.392862 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:33.392811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:33.742878 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:33.742787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:33.843182 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:33.843148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:33.944000 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:33.943973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:36.487037 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:36.487010 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 19:31:36.493157 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:36.493135 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-97lw7_eb9298ab-5021-46a3-85a4-bfb516910a53/serve-healthcheck-canary/0.log" Jun 03 19:31:39.783496 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:39.783456 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:39.883985 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:39.883949 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:40.775650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:40.775623 2558 generic.go:356] "Generic (PLEG): container finished" podID="33aec51f-a9fd-49b2-b1a1-1ee28a964077" containerID="821b0590addb2a331287d47556e3346299cfc8cefa647dd457c9f7308f19b5fe" exitCode=0 Jun 03 19:31:40.775801 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:40.775698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" event={"ID":"33aec51f-a9fd-49b2-b1a1-1ee28a964077","Type":"ContainerDied","Data":"821b0590addb2a331287d47556e3346299cfc8cefa647dd457c9f7308f19b5fe"} Jun 03 19:31:40.776004 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:40.775991 2558 scope.go:117] "RemoveContainer" containerID="821b0590addb2a331287d47556e3346299cfc8cefa647dd457c9f7308f19b5fe" Jun 03 19:31:41.408028 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:41.407997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:41.509031 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:41.508995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:41.780786 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:41.780746 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" podUID="1160a6a2-5429-4307-800e-2a2b8e884081" containerName="registry" containerID="cri-o://a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c" gracePeriod=30 Jun 03 19:31:41.781666 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:41.781636 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc" event={"ID":"33aec51f-a9fd-49b2-b1a1-1ee28a964077","Type":"ContainerStarted","Data":"252c29eb75dfdcdb42c39cde4cb78ca922b011c70a0081d45d45b4676f1e4994"} Jun 03 19:31:42.015316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.015295 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:31:42.041462 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041400 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041467 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041509 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041539 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041567 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041591 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041642 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppkhs\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.041727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.041673 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates\") pod \"1160a6a2-5429-4307-800e-2a2b8e884081\" (UID: \"1160a6a2-5429-4307-800e-2a2b8e884081\") " Jun 03 19:31:42.042261 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.042234 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:31:42.042484 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.042394 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:31:42.044727 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.044687 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:42.046086 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.046056 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:31:42.046524 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.046490 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs" (OuterVolumeSpecName: "kube-api-access-ppkhs") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "kube-api-access-ppkhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:42.046709 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.046681 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:42.047632 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.047609 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:31:42.051119 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.051097 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1160a6a2-5429-4307-800e-2a2b8e884081" (UID: "1160a6a2-5429-4307-800e-2a2b8e884081"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:31:42.142784 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142754 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppkhs\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-kube-api-access-ppkhs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142784 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142781 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-registry-certificates\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142791 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-image-registry-private-configuration\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142800 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1160a6a2-5429-4307-800e-2a2b8e884081-ca-trust-extracted\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142809 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-bound-sa-token\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142817 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1160a6a2-5429-4307-800e-2a2b8e884081-trusted-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142824 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1160a6a2-5429-4307-800e-2a2b8e884081-registry-tls\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.142962 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.142832 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1160a6a2-5429-4307-800e-2a2b8e884081-installation-pull-secrets\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:31:42.786389 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.786345 2558 generic.go:356] "Generic (PLEG): container finished" podID="1160a6a2-5429-4307-800e-2a2b8e884081" containerID="a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c" exitCode=0 Jun 03 19:31:42.786389 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.786391 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" Jun 03 19:31:42.786881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.786429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" event={"ID":"1160a6a2-5429-4307-800e-2a2b8e884081","Type":"ContainerDied","Data":"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c"} Jun 03 19:31:42.786881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.786480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dfddf4bd-rzwpz" event={"ID":"1160a6a2-5429-4307-800e-2a2b8e884081","Type":"ContainerDied","Data":"3efe3b617c4c32d2210601aba5cb32f7049281b160c6300c411b234dd22d7979"} Jun 03 19:31:42.786881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.786501 2558 scope.go:117] "RemoveContainer" containerID="a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c" Jun 03 19:31:42.796582 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.796536 2558 scope.go:117] "RemoveContainer" containerID="a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c" Jun 03 19:31:42.796889 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:31:42.796866 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c\": container with ID starting with a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c not found: ID does not exist" containerID="a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c" Jun 03 19:31:42.796990 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.796899 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c"} err="failed to get container status \"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c\": rpc error: code = NotFound desc = could not find container \"a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c\": container with ID starting with a9d8bf7d68be2553ecd639b6ea730d29a279e474abac984608305c0e027ef73c not found: ID does not exist" Jun 03 19:31:42.811115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.811093 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:31:42.815803 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:42.815777 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64dfddf4bd-rzwpz"] Jun 03 19:31:43.107906 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:43.107797 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1160a6a2-5429-4307-800e-2a2b8e884081" path="/var/lib/kubelet/pods/1160a6a2-5429-4307-800e-2a2b8e884081/volumes" Jun 03 19:31:45.797830 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:45.797798 2558 generic.go:356] "Generic (PLEG): container finished" podID="d2e6c2a1-d809-4b23-b1bd-6dbec1220080" containerID="ed1d9c399781be66dcc12d92f743110300baee169cb7660e5533161d3fd6e296" exitCode=0 Jun 03 19:31:45.798186 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:45.797838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" event={"ID":"d2e6c2a1-d809-4b23-b1bd-6dbec1220080","Type":"ContainerDied","Data":"ed1d9c399781be66dcc12d92f743110300baee169cb7660e5533161d3fd6e296"} Jun 03 19:31:45.798186 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:45.798131 2558 scope.go:117] "RemoveContainer" containerID="ed1d9c399781be66dcc12d92f743110300baee169cb7660e5533161d3fd6e296" Jun 03 19:31:46.803375 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:46.803343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-5lwp6" event={"ID":"d2e6c2a1-d809-4b23-b1bd-6dbec1220080","Type":"ContainerStarted","Data":"7c9e03298831c1a1f60d47d6ec853b2d19600e812d461825d02facddee2c673f"} Jun 03 19:31:48.353418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:48.353382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:48.417114 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:31:48.417080 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:04.371039 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:04.370969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:15.012152 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:15.012078 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:15.068569 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:15.068539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:27.324020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:27.323979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:27.411174 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:27.411133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:35.860988 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:35.860952 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:35.925894 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:35.925869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:39.173074 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:39.173036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:39.230345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:39.230314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:46.434616 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:46.434573 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:46.540096 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:46.540070 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:48.356008 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:48.355970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:48.452428 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:48.452391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:48.564513 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:48.564490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:49.548513 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:32:49.548474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:06.587770 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:33:06.587717 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:06.646798 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:33:06.646768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:37.804483 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:33:37.804409 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:33:37.884035 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:33:37.883998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:09.980548 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:09.980513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:10.968900 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:10.968866 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:11.975864 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.975829 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm"] Jun 03 19:34:11.976214 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.976075 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1160a6a2-5429-4307-800e-2a2b8e884081" containerName="registry" Jun 03 19:34:11.976214 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.976086 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1160a6a2-5429-4307-800e-2a2b8e884081" containerName="registry" Jun 03 19:34:11.976214 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.976131 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1160a6a2-5429-4307-800e-2a2b8e884081" containerName="registry" Jun 03 19:34:11.978899 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.978883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:11.984023 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.984002 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:11.984321 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.984304 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vzrhq\"" Jun 03 19:34:11.994484 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:11.994467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:12.002555 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.002527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm"] Jun 03 19:34:12.039398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.039371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8cfb74e-43a8-4c4b-b065-243934856a54-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.039496 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.039428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqhn\" (UniqueName: \"kubernetes.io/projected/d8cfb74e-43a8-4c4b-b065-243934856a54-kube-api-access-zcqhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.139867 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.139821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqhn\" (UniqueName: \"kubernetes.io/projected/d8cfb74e-43a8-4c4b-b065-243934856a54-kube-api-access-zcqhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.139971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.139884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8cfb74e-43a8-4c4b-b065-243934856a54-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.140208 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.140193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8cfb74e-43a8-4c4b-b065-243934856a54-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.151465 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.151442 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqhn\" (UniqueName: \"kubernetes.io/projected/d8cfb74e-43a8-4c4b-b065-243934856a54-kube-api-access-zcqhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-92kgm\" (UID: \"d8cfb74e-43a8-4c4b-b065-243934856a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.287240 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.287223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" Jun 03 19:34:12.417695 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.417640 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm"] Jun 03 19:34:12.420738 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:34:12.420710 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8cfb74e_43a8_4c4b_b065_243934856a54.slice/crio-1b98bff54519985a40ed6ad882d21882d57367f9e3b33609270df24566b98571 WatchSource:0}: Error finding container 1b98bff54519985a40ed6ad882d21882d57367f9e3b33609270df24566b98571: Status 404 returned error can't find the container with id 1b98bff54519985a40ed6ad882d21882d57367f9e3b33609270df24566b98571 Jun 03 19:34:12.812465 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:12.812437 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:13.285576 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:13.285539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" event={"ID":"d8cfb74e-43a8-4c4b-b065-243934856a54","Type":"ContainerStarted","Data":"1b98bff54519985a40ed6ad882d21882d57367f9e3b33609270df24566b98571"} Jun 03 19:34:13.788367 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:13.788330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:13.889670 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:13.889625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:15.294393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:15.294366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" event={"ID":"d8cfb74e-43a8-4c4b-b065-243934856a54","Type":"ContainerStarted","Data":"b76b5daf35ee8e03ec7d5b796d72060549eb54eb96edd0544ab024e3e7b7efb5"} Jun 03 19:34:15.320698 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:15.316080 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-92kgm" podStartSLOduration=1.803788127 podStartE2EDuration="4.316062242s" totalImagesPullingTime="2.512274115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:15.313591504 +0000 UTC m=+298.707116410" watchObservedRunningTime="2026-06-03 19:34:15.316062242 +0000 UTC m=+298.709587150" Jun 03 19:34:15.714982 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:15.714901 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:15.831024 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:15.830994 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:16.468456 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.468427 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4"] Jun 03 19:34:16.471722 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.471708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.475212 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.475186 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:34:16.475328 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.475190 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:34:16.475990 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.475971 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:34:16.490626 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.490594 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4"] Jun 03 19:34:16.574578 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.574555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.574717 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.574583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.574717 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.574603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlw7\" (UniqueName: \"kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.675803 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.675773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.675951 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.675817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlw7\" (UniqueName: \"kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.675951 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.675940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.676217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.676198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.676254 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.676202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.684239 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.684219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlw7\" (UniqueName: \"kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.780220 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.780193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:16.904134 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:16.904105 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4"] Jun 03 19:34:16.906926 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:34:16.906899 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd258b9d_a05f_4a7b_ae90_83a3807f43ec.slice/crio-2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d WatchSource:0}: Error finding container 2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d: Status 404 returned error can't find the container with id 2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d Jun 03 19:34:17.048591 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:17.048527 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:34:17.301395 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:17.301330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" event={"ID":"fd258b9d-a05f-4a7b-ae90-83a3807f43ec","Type":"ContainerStarted","Data":"2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d"} Jun 03 19:34:19.407419 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:19.407380 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:19.611421 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:19.611370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:20.785423 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:20.785358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:20.843278 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:20.843239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:22.327092 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:22.327063 2558 generic.go:356] "Generic (PLEG): container finished" podID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerID="9e96108ffd1520becbbd77e621ed89ab9c18acd06cb21ecea088e547e7b5bcf1" exitCode=0 Jun 03 19:34:22.327477 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:22.327120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" event={"ID":"fd258b9d-a05f-4a7b-ae90-83a3807f43ec","Type":"ContainerDied","Data":"9e96108ffd1520becbbd77e621ed89ab9c18acd06cb21ecea088e547e7b5bcf1"} Jun 03 19:34:22.328102 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:22.328084 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:34:25.342183 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:25.342148 2558 generic.go:356] "Generic (PLEG): container finished" podID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerID="eaf4053af5783fc44e7435df2222da002a4727fb9df534794d87054d8ee4aad8" exitCode=0 Jun 03 19:34:25.342642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:25.342238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" event={"ID":"fd258b9d-a05f-4a7b-ae90-83a3807f43ec","Type":"ContainerDied","Data":"eaf4053af5783fc44e7435df2222da002a4727fb9df534794d87054d8ee4aad8"} Jun 03 19:34:25.847963 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:25.847925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:25.903350 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:25.903319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:26.401103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:26.401063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:33.373255 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:33.373225 2558 generic.go:356] "Generic (PLEG): container finished" podID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerID="959ac0bc53b3ea646841199b5d02d1f9048dde5826386a6bac4775a4c42e3e2d" exitCode=0 Jun 03 19:34:33.373648 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:33.373301 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" event={"ID":"fd258b9d-a05f-4a7b-ae90-83a3807f43ec","Type":"ContainerDied","Data":"959ac0bc53b3ea646841199b5d02d1f9048dde5826386a6bac4775a4c42e3e2d"} Jun 03 19:34:34.536620 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.536592 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:34.621816 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.621792 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzlw7\" (UniqueName: \"kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7\") pod \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " Jun 03 19:34:34.621971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.621842 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle\") pod \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " Jun 03 19:34:34.621971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.621890 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util\") pod \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\" (UID: \"fd258b9d-a05f-4a7b-ae90-83a3807f43ec\") " Jun 03 19:34:34.622210 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.622184 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle" (OuterVolumeSpecName: "bundle") pod "fd258b9d-a05f-4a7b-ae90-83a3807f43ec" (UID: "fd258b9d-a05f-4a7b-ae90-83a3807f43ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:34.623940 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.623911 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7" (OuterVolumeSpecName: "kube-api-access-fzlw7") pod "fd258b9d-a05f-4a7b-ae90-83a3807f43ec" (UID: "fd258b9d-a05f-4a7b-ae90-83a3807f43ec"). InnerVolumeSpecName "kube-api-access-fzlw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:34.626005 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.625987 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util" (OuterVolumeSpecName: "util") pod "fd258b9d-a05f-4a7b-ae90-83a3807f43ec" (UID: "fd258b9d-a05f-4a7b-ae90-83a3807f43ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:34.722443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.722376 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzlw7\" (UniqueName: \"kubernetes.io/projected/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-kube-api-access-fzlw7\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:34:34.722443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.722396 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:34:34.722443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:34.722405 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd258b9d-a05f-4a7b-ae90-83a3807f43ec-util\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:34:35.383060 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:35.382995 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" Jun 03 19:34:35.383190 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:35.382990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flssm4" event={"ID":"fd258b9d-a05f-4a7b-ae90-83a3807f43ec","Type":"ContainerDied","Data":"2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d"} Jun 03 19:34:35.383190 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:35.383109 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bcfc6cc5321fd659296642883c1c949c8b1afb89bad6c71a0d016b27314765d" Jun 03 19:34:40.145675 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:40.145633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:40.251205 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:40.251162 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:42.106280 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106246 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv"] Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106478 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="util" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106487 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="util" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106498 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="pull" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106503 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="pull" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106513 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="extract" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106520 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="extract" Jun 03 19:34:42.106642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.106562 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd258b9d-a05f-4a7b-ae90-83a3807f43ec" containerName="extract" Jun 03 19:34:42.109368 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.109352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.111697 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.111677 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.112402 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.112386 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.112508 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.112488 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t6fls\"" Jun 03 19:34:42.119470 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.119450 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv"] Jun 03 19:34:42.274685 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.274657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4qz\" (UniqueName: \"kubernetes.io/projected/9d549710-c6bf-4349-8b1e-7759d3678720-kube-api-access-5f4qz\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.274806 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.274713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d549710-c6bf-4349-8b1e-7759d3678720-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.375136 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.375052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d549710-c6bf-4349-8b1e-7759d3678720-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.375136 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.375104 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4qz\" (UniqueName: \"kubernetes.io/projected/9d549710-c6bf-4349-8b1e-7759d3678720-kube-api-access-5f4qz\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.375439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.375421 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d549710-c6bf-4349-8b1e-7759d3678720-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.383232 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.383207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4qz\" (UniqueName: \"kubernetes.io/projected/9d549710-c6bf-4349-8b1e-7759d3678720-kube-api-access-5f4qz\") pod \"openshift-lws-operator-fd8ccff4c-qgrrv\" (UID: \"9d549710-c6bf-4349-8b1e-7759d3678720\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.418405 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.418387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" Jun 03 19:34:42.543013 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:42.542955 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv"] Jun 03 19:34:42.545815 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:34:42.545790 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d549710_c6bf_4349_8b1e_7759d3678720.slice/crio-a4e5af18c223c5383f3e54642dcdd3381a87bdb8743cb0941ca93859c365859d WatchSource:0}: Error finding container a4e5af18c223c5383f3e54642dcdd3381a87bdb8743cb0941ca93859c365859d: Status 404 returned error can't find the container with id a4e5af18c223c5383f3e54642dcdd3381a87bdb8743cb0941ca93859c365859d Jun 03 19:34:43.412027 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:43.411993 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" event={"ID":"9d549710-c6bf-4349-8b1e-7759d3678720","Type":"ContainerStarted","Data":"a4e5af18c223c5383f3e54642dcdd3381a87bdb8743cb0941ca93859c365859d"} Jun 03 19:34:46.425060 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:46.425025 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" event={"ID":"9d549710-c6bf-4349-8b1e-7759d3678720","Type":"ContainerStarted","Data":"375d43a6ad051d3c54ca77a374ac5e5eeb0d92aceb430c9a8b3cef08e9f5eb20"} Jun 03 19:34:46.462092 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:46.462042 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qgrrv" podStartSLOduration=1.1610066749999999 podStartE2EDuration="4.462026546s" totalImagesPullingTime="3.301019871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:46.461769579 +0000 UTC m=+329.855294487" watchObservedRunningTime="2026-06-03 19:34:46.462026546 +0000 UTC m=+329.855551453" Jun 03 19:34:47.208725 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:47.208689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.317285 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:48.317252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:49.448379 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:49.448334 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:53.736530 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:53.736495 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:53.888914 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:34:53.888871 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:05.670380 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:05.670345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:05.805512 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:05.805480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.258556 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.258523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.497132 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.497057 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.599630 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.599533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.631877 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.631829 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2"] Jun 03 19:35:06.645950 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.645921 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648564 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvwt\" (UniqueName: \"kubernetes.io/projected/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-kube-api-access-hkvwt\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.648592 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648588 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:35:06.648867 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648606 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:35:06.648867 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648632 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-96mg5\"" Jun 03 19:35:06.648940 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.648877 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:35:06.655647 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.655619 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2"] Jun 03 19:35:06.748869 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.748816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvwt\" (UniqueName: \"kubernetes.io/projected/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-kube-api-access-hkvwt\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.749393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.748876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.749393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.748914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.749393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.748935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.749393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.748954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.749393 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.749385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.751242 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.751219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.751346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.751309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.751405 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.751388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.772226 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.772195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvwt\" (UniqueName: \"kubernetes.io/projected/05d2f422-e6e0-49ec-a142-b3e63b8f9b3a-kube-api-access-hkvwt\") pod \"opendatahub-operator-controller-manager-84dd8f948c-fdnq2\" (UID: \"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:06.839112 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.839073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.939942 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.939843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:06.956984 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:06.956962 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:07.039688 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.039642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:07.113010 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.112968 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2"] Jun 03 19:35:07.116207 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.116179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:07.117837 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:07.117811 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d2f422_e6e0_49ec_a142_b3e63b8f9b3a.slice/crio-bb601a8776e2fbcfd351163fcad23735fdc6ff9da467ae4d9221cf7b38a639b4 WatchSource:0}: Error finding container bb601a8776e2fbcfd351163fcad23735fdc6ff9da467ae4d9221cf7b38a639b4: Status 404 returned error can't find the container with id bb601a8776e2fbcfd351163fcad23735fdc6ff9da467ae4d9221cf7b38a639b4 Jun 03 19:35:07.209236 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.209151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:07.308663 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.308627 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:07.404983 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.404947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:07.504649 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:07.504621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" event={"ID":"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a","Type":"ContainerStarted","Data":"bb601a8776e2fbcfd351163fcad23735fdc6ff9da467ae4d9221cf7b38a639b4"} Jun 03 19:35:10.519037 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:10.519005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" event={"ID":"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a","Type":"ContainerStarted","Data":"4ffb28661387e736473aacdf8dad36e0abb898447977d6b3abb104d0d0bf5673"} Jun 03 19:35:11.526455 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:11.526416 2558 generic.go:356] "Generic (PLEG): container finished" podID="05d2f422-e6e0-49ec-a142-b3e63b8f9b3a" containerID="4ffb28661387e736473aacdf8dad36e0abb898447977d6b3abb104d0d0bf5673" exitCode=0 Jun 03 19:35:11.526907 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:11.526477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" event={"ID":"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a","Type":"ContainerDied","Data":"4ffb28661387e736473aacdf8dad36e0abb898447977d6b3abb104d0d0bf5673"} Jun 03 19:35:12.532033 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:12.531994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" event={"ID":"05d2f422-e6e0-49ec-a142-b3e63b8f9b3a","Type":"ContainerStarted","Data":"f7962a0a958a140725a43d3d77a96a5646bab7e94b4b62b4ee6116a20f596d1e"} Jun 03 19:35:12.532413 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:12.532133 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:12.555753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:12.555706 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" podStartSLOduration=2.491392051 podStartE2EDuration="6.555693634s" totalImagesPullingTime="3.093394378s" totalInitContainerRuntime="970.907205ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:12.55473488 +0000 UTC m=+355.948259788" watchObservedRunningTime="2026-06-03 19:35:12.555693634 +0000 UTC m=+355.949218540" Jun 03 19:35:17.611488 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:17.611450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.708795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:17.708754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:23.537568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:23.537537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-fdnq2" Jun 03 19:35:25.339810 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:25.339779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:25.453430 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:25.453395 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:25.611248 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:25.611163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:25.713200 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:25.713170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:25.870362 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:25.870285 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.023815 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.023781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.098553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.098524 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj"] Jun 03 19:35:26.108360 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.108338 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.111305 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.111284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj"] Jun 03 19:35:26.111786 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.111771 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 19:35:26.111861 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.111815 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 19:35:26.112557 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.112539 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-95qdl\"" Jun 03 19:35:26.189396 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.189314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fc926e-3d1b-4d4c-9874-0480f35faf70-tmp\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.189396 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.189354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fc926e-3d1b-4d4c-9874-0480f35faf70-tls-certs\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.189396 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.189381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ft9\" (UniqueName: \"kubernetes.io/projected/59fc926e-3d1b-4d4c-9874-0480f35faf70-kube-api-access-w7ft9\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.207975 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.207950 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9rlfg"] Jun 03 19:35:26.211227 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.211212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.214621 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.214599 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 19:35:26.214621 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.214616 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nrdpz\"" Jun 03 19:35:26.225946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.225920 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9rlfg"] Jun 03 19:35:26.245573 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.245547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.289772 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.289747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-cert\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.289929 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.289800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fc926e-3d1b-4d4c-9874-0480f35faf70-tmp\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.289929 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.289872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmvff\" (UniqueName: \"kubernetes.io/projected/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-kube-api-access-mmvff\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.289929 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.289910 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fc926e-3d1b-4d4c-9874-0480f35faf70-tls-certs\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.290088 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.289962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ft9\" (UniqueName: \"kubernetes.io/projected/59fc926e-3d1b-4d4c-9874-0480f35faf70-kube-api-access-w7ft9\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.292021 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.291987 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fc926e-3d1b-4d4c-9874-0480f35faf70-tmp\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.292147 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.292126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fc926e-3d1b-4d4c-9874-0480f35faf70-tls-certs\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.299221 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.299202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ft9\" (UniqueName: \"kubernetes.io/projected/59fc926e-3d1b-4d4c-9874-0480f35faf70-kube-api-access-w7ft9\") pod \"kube-auth-proxy-74b7b7cf99-hq8hj\" (UID: \"59fc926e-3d1b-4d4c-9874-0480f35faf70\") " pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.315270 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.315244 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.391053 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.391023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmvff\" (UniqueName: \"kubernetes.io/projected/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-kube-api-access-mmvff\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.391343 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.391076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-cert\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.393310 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.393292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-cert\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.402749 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.402726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmvff\" (UniqueName: \"kubernetes.io/projected/1fb40967-16f7-4e1c-a6e0-8d9d66393c22-kube-api-access-mmvff\") pod \"odh-model-controller-6dc94f689f-9rlfg\" (UID: \"1fb40967-16f7-4e1c-a6e0-8d9d66393c22\") " pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.417195 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.417173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.417955 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.417941 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" Jun 03 19:35:26.516486 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.516456 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.521194 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.521173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:26.539267 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.539248 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj"] Jun 03 19:35:26.541561 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:26.541537 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fc926e_3d1b_4d4c_9874_0480f35faf70.slice/crio-db509757cbccc7aaf4f2bcbc48c636d45ae094b728061d5cac55977fa2164aad WatchSource:0}: Error finding container db509757cbccc7aaf4f2bcbc48c636d45ae094b728061d5cac55977fa2164aad: Status 404 returned error can't find the container with id db509757cbccc7aaf4f2bcbc48c636d45ae094b728061d5cac55977fa2164aad Jun 03 19:35:26.585981 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.585952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" event={"ID":"59fc926e-3d1b-4d4c-9874-0480f35faf70","Type":"ContainerStarted","Data":"db509757cbccc7aaf4f2bcbc48c636d45ae094b728061d5cac55977fa2164aad"} Jun 03 19:35:26.646034 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:26.646006 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9rlfg"] Jun 03 19:35:26.648803 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:26.648777 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb40967_16f7_4e1c_a6e0_8d9d66393c22.slice/crio-00d62697527f941da84ead1b16ddf1b262ada1fc0956b6f174d148be56ee97b8 WatchSource:0}: Error finding container 00d62697527f941da84ead1b16ddf1b262ada1fc0956b6f174d148be56ee97b8: Status 404 returned error can't find the container with id 00d62697527f941da84ead1b16ddf1b262ada1fc0956b6f174d148be56ee97b8 Jun 03 19:35:27.007777 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.007746 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-62lh6"] Jun 03 19:35:27.012418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.012402 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.014733 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.014713 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 19:35:27.030139 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.030116 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-62lh6"] Jun 03 19:35:27.050349 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.050327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:27.095753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.095721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5whx\" (UniqueName: \"kubernetes.io/projected/94c6ca2a-c670-49e9-9294-865b12612904-kube-api-access-p5whx\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.095890 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.095766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6ca2a-c670-49e9-9294-865b12612904-tls-certs\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.196408 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.196315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6ca2a-c670-49e9-9294-865b12612904-tls-certs\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.196678 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.196451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5whx\" (UniqueName: \"kubernetes.io/projected/94c6ca2a-c670-49e9-9294-865b12612904-kube-api-access-p5whx\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.198546 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.198517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:27.199991 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.199963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c6ca2a-c670-49e9-9294-865b12612904-tls-certs\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.206159 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.206132 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5whx\" (UniqueName: \"kubernetes.io/projected/94c6ca2a-c670-49e9-9294-865b12612904-kube-api-access-p5whx\") pod \"model-serving-api-5dd488fc48-62lh6\" (UID: \"94c6ca2a-c670-49e9-9294-865b12612904\") " pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.322026 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.321956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:27.496508 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.496475 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-62lh6"] Jun 03 19:35:27.596730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.596647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" event={"ID":"94c6ca2a-c670-49e9-9294-865b12612904","Type":"ContainerStarted","Data":"699996c9db43880af40e8ae9ef731ed90ff0f3ea4f8de59bb6aef550d106e9a8"} Jun 03 19:35:27.598215 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.598164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" event={"ID":"1fb40967-16f7-4e1c-a6e0-8d9d66393c22","Type":"ContainerStarted","Data":"00d62697527f941da84ead1b16ddf1b262ada1fc0956b6f174d148be56ee97b8"} Jun 03 19:35:27.803293 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.801602 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z"] Jun 03 19:35:27.806773 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.806667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:27.809425 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.809252 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:35:27.809425 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.809289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:35:27.809593 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.809525 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:35:27.814254 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.814195 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z"] Jun 03 19:35:27.906668 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.906579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:27.906668 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.906648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzdkz\" (UniqueName: \"kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:27.906908 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:27.906677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.007670 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.007602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.007670 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.007661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzdkz\" (UniqueName: \"kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.007911 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.007690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.008218 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.008197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.008456 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.008437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.018335 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.018311 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzdkz\" (UniqueName: \"kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.122138 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.121938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:28.295424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:28.295388 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z"] Jun 03 19:35:29.068105 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:29.068068 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21274aa0_3c9f_43b9_be0e_0bef70002088.slice/crio-a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614 WatchSource:0}: Error finding container a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614: Status 404 returned error can't find the container with id a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614 Jun 03 19:35:29.612820 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:29.612782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" event={"ID":"21274aa0-3c9f-43b9-be0e-0bef70002088","Type":"ContainerStarted","Data":"a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614"} Jun 03 19:35:31.622569 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.622534 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" event={"ID":"59fc926e-3d1b-4d4c-9874-0480f35faf70","Type":"ContainerStarted","Data":"76a4a0e841fcc7f43fcebb47fb54ef51f62b66832f5159113a170efc79004bc3"} Jun 03 19:35:31.623872 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.623828 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" event={"ID":"94c6ca2a-c670-49e9-9294-865b12612904","Type":"ContainerStarted","Data":"37717c2119ec515e979b0dd19de972dc88b8c07e61fb7a16b9779dafcb9ef277"} Jun 03 19:35:31.624010 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.623889 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:31.625238 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.625215 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" event={"ID":"1fb40967-16f7-4e1c-a6e0-8d9d66393c22","Type":"ContainerStarted","Data":"71f4f4e757e55ca67dedfffa176b879bf4b8eb6187cdd006f95d50d3f50c321e"} Jun 03 19:35:31.625360 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.625265 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:31.626584 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.626561 2558 generic.go:356] "Generic (PLEG): container finished" podID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerID="3bbc18756d9b2a4bd129b21629935921164675c4cb2eca89bbd79bf668be94e1" exitCode=0 Jun 03 19:35:31.626661 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.626608 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" event={"ID":"21274aa0-3c9f-43b9-be0e-0bef70002088","Type":"ContainerDied","Data":"3bbc18756d9b2a4bd129b21629935921164675c4cb2eca89bbd79bf668be94e1"} Jun 03 19:35:31.642371 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.642331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74b7b7cf99-hq8hj" podStartSLOduration=0.997745398 podStartE2EDuration="5.642317828s" totalImagesPullingTime="4.64457243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:31.640473602 +0000 UTC m=+375.033998519" watchObservedRunningTime="2026-06-03 19:35:31.642317828 +0000 UTC m=+375.035842731" Jun 03 19:35:31.686096 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.686039 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" podStartSLOduration=1.136189565 podStartE2EDuration="5.686018466s" totalImagesPullingTime="4.549828901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:31.682978684 +0000 UTC m=+375.076503593" watchObservedRunningTime="2026-06-03 19:35:31.686018466 +0000 UTC m=+375.079543374" Jun 03 19:35:31.705784 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:31.705731 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" podStartSLOduration=2.025959313 podStartE2EDuration="5.70571729s" totalImagesPullingTime="3.679757977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:31.704411105 +0000 UTC m=+375.097936013" watchObservedRunningTime="2026-06-03 19:35:31.70571729 +0000 UTC m=+375.099242198" Jun 03 19:35:35.649022 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:35.648929 2558 generic.go:356] "Generic (PLEG): container finished" podID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerID="15879e985a663a15eebc56dbd3de6f39c3c7dbbbc8f3cee660adc6c554e64f8e" exitCode=0 Jun 03 19:35:35.649022 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:35.648983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" event={"ID":"21274aa0-3c9f-43b9-be0e-0bef70002088","Type":"ContainerDied","Data":"15879e985a663a15eebc56dbd3de6f39c3c7dbbbc8f3cee660adc6c554e64f8e"} Jun 03 19:35:36.586515 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.586465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.651099 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.651073 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s2dx2"] Jun 03 19:35:36.654083 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.654062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.655059 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.655035 2558 generic.go:356] "Generic (PLEG): container finished" podID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerID="3156be0a43dfe3daf1bf27a68777d3a8e81b9faf7b76f5ea69486e630b5fedd6" exitCode=0 Jun 03 19:35:36.655212 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.655140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" event={"ID":"21274aa0-3c9f-43b9-be0e-0bef70002088","Type":"ContainerDied","Data":"3156be0a43dfe3daf1bf27a68777d3a8e81b9faf7b76f5ea69486e630b5fedd6"} Jun 03 19:35:36.656459 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.656437 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sm66t\"" Jun 03 19:35:36.656532 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.656438 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 19:35:36.656934 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.656917 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf"] Jun 03 19:35:36.659753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.659737 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.665588 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.662262 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w2f7n\"" Jun 03 19:35:36.665588 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.662270 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 19:35:36.668820 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.668781 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s2dx2"] Jun 03 19:35:36.671819 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.671795 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf"] Jun 03 19:35:36.681463 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.681438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.779004 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.778976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqsc8\" (UniqueName: \"kubernetes.io/projected/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-kube-api-access-zqsc8\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.779115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.779018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.779115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.779048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.779115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.779063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sch4l\" (UniqueName: \"kubernetes.io/projected/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-kube-api-access-sch4l\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.835084 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.835051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.880292 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.880236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.880292 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.880272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.880292 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.880290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sch4l\" (UniqueName: \"kubernetes.io/projected/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-kube-api-access-sch4l\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.880448 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.880401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqsc8\" (UniqueName: \"kubernetes.io/projected/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-kube-api-access-zqsc8\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.880494 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:35:36.880448 2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 19:35:36.880531 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:35:36.880514 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert podName:5405fe7a-513c-4ba6-b2b9-40cf035cbfa1 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:37.380494022 +0000 UTC m=+380.774018907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert") pod "kserve-controller-manager-69fc866d76-s2dx2" (UID: "5405fe7a-513c-4ba6-b2b9-40cf035cbfa1") : secret "kserve-webhook-server-cert" not found Jun 03 19:35:36.882614 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.882590 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.919645 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.919622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sch4l\" (UniqueName: \"kubernetes.io/projected/7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e-kube-api-access-sch4l\") pod \"llmisvc-controller-manager-864bfd7bc9-lvzgf\" (UID: \"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:36.935299 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.935281 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqsc8\" (UniqueName: \"kubernetes.io/projected/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-kube-api-access-zqsc8\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:36.975980 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:36.975956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:37.002093 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.002066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:37.100627 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.100601 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf"] Jun 03 19:35:37.103000 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:37.102970 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ae3ac5f_c3f1_48fa_9556_dcd82bb8238e.slice/crio-844933e32aaa92e58cf38cd4086f1a04a3d9c68f22cdb9c1e38c5d4abe5ae324 WatchSource:0}: Error finding container 844933e32aaa92e58cf38cd4086f1a04a3d9c68f22cdb9c1e38c5d4abe5ae324: Status 404 returned error can't find the container with id 844933e32aaa92e58cf38cd4086f1a04a3d9c68f22cdb9c1e38c5d4abe5ae324 Jun 03 19:35:37.384975 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.384939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:37.387264 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.387243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5405fe7a-513c-4ba6-b2b9-40cf035cbfa1-cert\") pod \"kserve-controller-manager-69fc866d76-s2dx2\" (UID: \"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:37.566923 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.566888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:37.661436 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.661402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" event={"ID":"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e","Type":"ContainerStarted","Data":"844933e32aaa92e58cf38cd4086f1a04a3d9c68f22cdb9c1e38c5d4abe5ae324"} Jun 03 19:35:37.696832 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.696801 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s2dx2"] Jun 03 19:35:37.700438 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:37.700398 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5405fe7a_513c_4ba6_b2b9_40cf035cbfa1.slice/crio-c6c318a3b101ac81fe31aa42ab2a059b744fb38cedad084f89053564c3ac5f71 WatchSource:0}: Error finding container c6c318a3b101ac81fe31aa42ab2a059b744fb38cedad084f89053564c3ac5f71: Status 404 returned error can't find the container with id c6c318a3b101ac81fe31aa42ab2a059b744fb38cedad084f89053564c3ac5f71 Jun 03 19:35:37.793562 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.793540 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:37.890103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.889797 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util\") pod \"21274aa0-3c9f-43b9-be0e-0bef70002088\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " Jun 03 19:35:37.890103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.889882 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzdkz\" (UniqueName: \"kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz\") pod \"21274aa0-3c9f-43b9-be0e-0bef70002088\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " Jun 03 19:35:37.890103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.889922 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle\") pod \"21274aa0-3c9f-43b9-be0e-0bef70002088\" (UID: \"21274aa0-3c9f-43b9-be0e-0bef70002088\") " Jun 03 19:35:37.891766 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.891697 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle" (OuterVolumeSpecName: "bundle") pod "21274aa0-3c9f-43b9-be0e-0bef70002088" (UID: "21274aa0-3c9f-43b9-be0e-0bef70002088"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:35:37.892180 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.892143 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz" (OuterVolumeSpecName: "kube-api-access-qzdkz") pod "21274aa0-3c9f-43b9-be0e-0bef70002088" (UID: "21274aa0-3c9f-43b9-be0e-0bef70002088"). InnerVolumeSpecName "kube-api-access-qzdkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:35:37.895697 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.895621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:37.896311 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.896286 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util" (OuterVolumeSpecName: "util") pod "21274aa0-3c9f-43b9-be0e-0bef70002088" (UID: "21274aa0-3c9f-43b9-be0e-0bef70002088"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:35:37.991020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.990990 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzdkz\" (UniqueName: \"kubernetes.io/projected/21274aa0-3c9f-43b9-be0e-0bef70002088-kube-api-access-qzdkz\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:37.991020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.991012 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:37.991020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:37.991021 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21274aa0-3c9f-43b9-be0e-0bef70002088-util\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:38.005586 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.005557 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:38.096464 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.096429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:38.672553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.671194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" event={"ID":"21274aa0-3c9f-43b9-be0e-0bef70002088","Type":"ContainerDied","Data":"a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614"} Jun 03 19:35:38.672553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.671248 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5afd0457ba709c957a1c14f7e8a870abd9e14256e35c08e9f2eb208e7fe4614" Jun 03 19:35:38.672553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.671333 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0662m2z" Jun 03 19:35:38.673778 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:38.673745 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" event={"ID":"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1","Type":"ContainerStarted","Data":"c6c318a3b101ac81fe31aa42ab2a059b744fb38cedad084f89053564c3ac5f71"} Jun 03 19:35:41.688881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.688831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" event={"ID":"7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e","Type":"ContainerStarted","Data":"31695c0a12c32c66a04f950159cd7c45e0cb0178f79e9754ccf8c06d01acbaee"} Jun 03 19:35:41.689312 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.688948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:35:41.690214 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.690191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" event={"ID":"5405fe7a-513c-4ba6-b2b9-40cf035cbfa1","Type":"ContainerStarted","Data":"9c7e5777615721053e2cb104437c5900106ea883ab1dfaec385239f9e1fda112"} Jun 03 19:35:41.690354 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.690332 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:35:41.759594 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.759541 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" podStartSLOduration=2.708658841 podStartE2EDuration="5.75952582s" totalImagesPullingTime="3.050866979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:41.759294508 +0000 UTC m=+385.152819416" watchObservedRunningTime="2026-06-03 19:35:41.75952582 +0000 UTC m=+385.153050776" Jun 03 19:35:41.806734 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:41.806678 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" podStartSLOduration=2.77901373 podStartE2EDuration="5.80666258s" totalImagesPullingTime="3.02764885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:41.80409017 +0000 UTC m=+385.197615076" watchObservedRunningTime="2026-06-03 19:35:41.80666258 +0000 UTC m=+385.200187484" Jun 03 19:35:42.043514 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:42.043483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:42.146496 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:42.146461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:42.633464 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:42.633434 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9rlfg" Jun 03 19:35:42.635285 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:42.635257 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-62lh6" Jun 03 19:35:43.367356 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.367309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:43.460490 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460456 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m"] Jun 03 19:35:43.460745 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460733 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="extract" Jun 03 19:35:43.460795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460746 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="extract" Jun 03 19:35:43.460795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460760 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="util" Jun 03 19:35:43.460795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460766 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="util" Jun 03 19:35:43.460795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460781 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="pull" Jun 03 19:35:43.460795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460787 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="pull" Jun 03 19:35:43.461258 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.460865 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="21274aa0-3c9f-43b9-be0e-0bef70002088" containerName="extract" Jun 03 19:35:43.464041 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.464027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.466437 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.466417 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:35:43.466967 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.466944 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:35:43.467266 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.467250 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:35:43.479324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.479300 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m"] Jun 03 19:35:43.542374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.542339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkh4\" (UniqueName: \"kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.542558 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.542383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.542558 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.542523 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.643269 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.643179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.643269 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.643231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkh4\" (UniqueName: \"kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.643561 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.643263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.643660 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.643637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.643713 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.643657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.660073 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.660043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkh4\" (UniqueName: \"kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.773188 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.773153 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:43.931687 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:43.931614 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m"] Jun 03 19:35:43.934415 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:43.934380 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff72556_c735_4ba8_975e_e6b6122753b5.slice/crio-1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8 WatchSource:0}: Error finding container 1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8: Status 404 returned error can't find the container with id 1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8 Jun 03 19:35:44.044942 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.044904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.153422 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.153393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.706115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.706085 2558 generic.go:356] "Generic (PLEG): container finished" podID="dff72556-c735-4ba8-975e-e6b6122753b5" containerID="77194ab0e3badc42726a890671d9854222799f1b755f46401e52a9ef2b019bf0" exitCode=0 Jun 03 19:35:44.706439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.706172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" event={"ID":"dff72556-c735-4ba8-975e-e6b6122753b5","Type":"ContainerDied","Data":"77194ab0e3badc42726a890671d9854222799f1b755f46401e52a9ef2b019bf0"} Jun 03 19:35:44.706439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.706217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" event={"ID":"dff72556-c735-4ba8-975e-e6b6122753b5","Type":"ContainerStarted","Data":"1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8"} Jun 03 19:35:44.751281 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.751261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.990200 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.990134 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c24hp"] Jun 03 19:35:44.992067 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.992051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:44.994381 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.994356 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 19:35:44.994478 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.994464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6crpp\"" Jun 03 19:35:44.994787 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:44.994770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 19:35:45.008207 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.008188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c24hp"] Jun 03 19:35:45.059143 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.059112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6v5\" (UniqueName: \"kubernetes.io/projected/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-kube-api-access-gn6v5\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.059255 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.059167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.160201 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.160174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6v5\" (UniqueName: \"kubernetes.io/projected/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-kube-api-access-gn6v5\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.160325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.160219 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.162516 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.162495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.169348 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.169327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6v5\" (UniqueName: \"kubernetes.io/projected/556d13d0-e078-4ca4-92ac-13ae9abc9f2f-kube-api-access-gn6v5\") pod \"servicemesh-operator3-57f65f65fb-c24hp\" (UID: \"556d13d0-e078-4ca4-92ac-13ae9abc9f2f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.302402 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.302378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:45.466445 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.466420 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c24hp"] Jun 03 19:35:45.468373 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:45.468349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556d13d0_e078_4ca4_92ac_13ae9abc9f2f.slice/crio-30ddf095dd0f8b21c4dea9479af5cfe4e273faaa828e6ca17e431326207bf72c WatchSource:0}: Error finding container 30ddf095dd0f8b21c4dea9479af5cfe4e273faaa828e6ca17e431326207bf72c: Status 404 returned error can't find the container with id 30ddf095dd0f8b21c4dea9479af5cfe4e273faaa828e6ca17e431326207bf72c Jun 03 19:35:45.712265 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:45.712191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" event={"ID":"556d13d0-e078-4ca4-92ac-13ae9abc9f2f","Type":"ContainerStarted","Data":"30ddf095dd0f8b21c4dea9479af5cfe4e273faaa828e6ca17e431326207bf72c"} Jun 03 19:35:48.728314 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:48.728276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" event={"ID":"556d13d0-e078-4ca4-92ac-13ae9abc9f2f","Type":"ContainerStarted","Data":"799113864e516acec2854da1306e42cfcbc54392fe68f357bbf701e07d6eb2b6"} Jun 03 19:35:48.728747 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:48.728346 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:35:48.769403 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:48.769350 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" podStartSLOduration=2.316740668 podStartE2EDuration="4.769337896s" totalImagesPullingTime="2.452597228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:48.768014347 +0000 UTC m=+392.161539252" watchObservedRunningTime="2026-06-03 19:35:48.769337896 +0000 UTC m=+392.162862803" Jun 03 19:35:49.735094 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:49.735061 2558 generic.go:356] "Generic (PLEG): container finished" podID="dff72556-c735-4ba8-975e-e6b6122753b5" containerID="9a7ca1331e2ff04378902c3d85457140f1f76686bb2b94fb4d7473f2fd305397" exitCode=0 Jun 03 19:35:49.735565 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:49.735154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" event={"ID":"dff72556-c735-4ba8-975e-e6b6122753b5","Type":"ContainerDied","Data":"9a7ca1331e2ff04378902c3d85457140f1f76686bb2b94fb4d7473f2fd305397"} Jun 03 19:35:50.742390 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:50.742354 2558 generic.go:356] "Generic (PLEG): container finished" podID="dff72556-c735-4ba8-975e-e6b6122753b5" containerID="6c7bded8b8fad5e873b04e36224dfd3b954c16a2b29d472011a12fd8f7d43351" exitCode=0 Jun 03 19:35:50.742762 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:50.742427 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" event={"ID":"dff72556-c735-4ba8-975e-e6b6122753b5","Type":"ContainerDied","Data":"6c7bded8b8fad5e873b04e36224dfd3b954c16a2b29d472011a12fd8f7d43351"} Jun 03 19:35:51.874413 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:51.874390 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:52.011224 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.011204 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle\") pod \"dff72556-c735-4ba8-975e-e6b6122753b5\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " Jun 03 19:35:52.011359 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.011260 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pkh4\" (UniqueName: \"kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4\") pod \"dff72556-c735-4ba8-975e-e6b6122753b5\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " Jun 03 19:35:52.011359 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.011292 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util\") pod \"dff72556-c735-4ba8-975e-e6b6122753b5\" (UID: \"dff72556-c735-4ba8-975e-e6b6122753b5\") " Jun 03 19:35:52.012109 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.012075 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle" (OuterVolumeSpecName: "bundle") pod "dff72556-c735-4ba8-975e-e6b6122753b5" (UID: "dff72556-c735-4ba8-975e-e6b6122753b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:35:52.013282 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.013256 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4" (OuterVolumeSpecName: "kube-api-access-8pkh4") pod "dff72556-c735-4ba8-975e-e6b6122753b5" (UID: "dff72556-c735-4ba8-975e-e6b6122753b5"). InnerVolumeSpecName "kube-api-access-8pkh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:35:52.015980 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.015949 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util" (OuterVolumeSpecName: "util") pod "dff72556-c735-4ba8-975e-e6b6122753b5" (UID: "dff72556-c735-4ba8-975e-e6b6122753b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:35:52.112690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.112665 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pkh4\" (UniqueName: \"kubernetes.io/projected/dff72556-c735-4ba8-975e-e6b6122753b5-kube-api-access-8pkh4\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:52.112690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.112684 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-util\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:52.112690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.112694 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff72556-c735-4ba8-975e-e6b6122753b5-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:35:52.752324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.752297 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" Jun 03 19:35:52.752488 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.752297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awsg5m" event={"ID":"dff72556-c735-4ba8-975e-e6b6122753b5","Type":"ContainerDied","Data":"1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8"} Jun 03 19:35:52.752488 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:52.752412 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e9cd679bec2cf686768adfef98951dc1ef7bd3ff2d6501bed348d3ba009d3a8" Jun 03 19:35:55.111352 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:55.111262 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:55.210689 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:55.210660 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:56.378982 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.378953 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-rqwhn"] Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379231 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="util" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379241 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="util" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379253 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="extract" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379259 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="extract" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379273 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="pull" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379278 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="pull" Jun 03 19:35:56.379345 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.379325 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dff72556-c735-4ba8-975e-e6b6122753b5" containerName="extract" Jun 03 19:35:56.382746 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.382727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.386996 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.386979 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9bk22\"" Jun 03 19:35:56.387892 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.387876 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:35:56.393871 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.393830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-rqwhn"] Jun 03 19:35:56.443936 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.443905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:56.541241 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.541215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/344d0e3f-0e1d-4956-92ad-a222af47e0d9-redirect-config\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.541386 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.541241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9wn\" (UniqueName: \"kubernetes.io/projected/344d0e3f-0e1d-4956-92ad-a222af47e0d9-kube-api-access-tz9wn\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.642490 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.642420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/344d0e3f-0e1d-4956-92ad-a222af47e0d9-redirect-config\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.642490 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.642454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9wn\" (UniqueName: \"kubernetes.io/projected/344d0e3f-0e1d-4956-92ad-a222af47e0d9-kube-api-access-tz9wn\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.643121 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.643102 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/344d0e3f-0e1d-4956-92ad-a222af47e0d9-redirect-config\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.652507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.652489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9wn\" (UniqueName: \"kubernetes.io/projected/344d0e3f-0e1d-4956-92ad-a222af47e0d9-kube-api-access-tz9wn\") pod \"dashboard-redirect-7f58cfb955-rqwhn\" (UID: \"344d0e3f-0e1d-4956-92ad-a222af47e0d9\") " pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.692128 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.692104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" Jun 03 19:35:56.826602 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:56.826578 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-rqwhn"] Jun 03 19:35:56.829023 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:35:56.828997 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344d0e3f_0e1d_4956_92ad_a222af47e0d9.slice/crio-d63a770fdf481a313cd8c28357cc966b9a2c718a4b0002ecd617d5ab8a1cf604 WatchSource:0}: Error finding container d63a770fdf481a313cd8c28357cc966b9a2c718a4b0002ecd617d5ab8a1cf604: Status 404 returned error can't find the container with id d63a770fdf481a313cd8c28357cc966b9a2c718a4b0002ecd617d5ab8a1cf604 Jun 03 19:35:57.775279 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:57.775243 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" event={"ID":"344d0e3f-0e1d-4956-92ad-a222af47e0d9","Type":"ContainerStarted","Data":"d63a770fdf481a313cd8c28357cc966b9a2c718a4b0002ecd617d5ab8a1cf604"} Jun 03 19:35:59.738524 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:35:59.738493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c24hp" Jun 03 19:36:02.802894 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:02.802842 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" event={"ID":"344d0e3f-0e1d-4956-92ad-a222af47e0d9","Type":"ContainerStarted","Data":"1a522e368fde1280ba51c2e8123eb3894156bc23ed2a3a1896c6aeac3582084b"} Jun 03 19:36:02.821068 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:02.821023 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7f58cfb955-rqwhn" podStartSLOduration=0.970684783 podStartE2EDuration="6.82100851s" totalImagesPullingTime="5.850323727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:02.819593568 +0000 UTC m=+406.213118474" watchObservedRunningTime="2026-06-03 19:36:02.82100851 +0000 UTC m=+406.214533428" Jun 03 19:36:12.696870 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:12.696815 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lvzgf" Jun 03 19:36:12.700398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:12.700374 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-s2dx2" Jun 03 19:36:15.151045 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.151011 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd"] Jun 03 19:36:15.155538 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.155520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.157394 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.157366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:15.157935 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.157922 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 19:36:15.157999 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.157923 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 19:36:15.158320 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.158301 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:36:15.158389 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.158367 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fflr9\"" Jun 03 19:36:15.158389 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.158314 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 19:36:15.171115 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.171090 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd"] Jun 03 19:36:15.187721 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.187813 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.187813 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187757 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhz8\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-kube-api-access-gwhz8\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.187916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.187916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.187916 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.188040 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.187916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.236264 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.236242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:15.288310 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288407 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288407 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhz8\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-kube-api-access-gwhz8\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288704 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288806 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288806 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.288806 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.288792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.289346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.289324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.290752 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.290734 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.291295 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.291279 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.291463 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.291443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.291521 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.291443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.297340 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.297313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.297534 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.297516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhz8\" (UniqueName: \"kubernetes.io/projected/ea6ca8ef-b85a-416b-843d-fad3d3b51b96-kube-api-access-gwhz8\") pod \"istiod-openshift-gateway-75c67f8887-mz8hd\" (UID: \"ea6ca8ef-b85a-416b-843d-fad3d3b51b96\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.464817 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.464732 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:15.593953 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.593932 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd"] Jun 03 19:36:15.595759 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:36:15.595733 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6ca8ef_b85a_416b_843d_fad3d3b51b96.slice/crio-f4abacb4ca1407bfc1269f4a57ff265ac094e72a63d96a07d0cff8dbda3595a9 WatchSource:0}: Error finding container f4abacb4ca1407bfc1269f4a57ff265ac094e72a63d96a07d0cff8dbda3595a9: Status 404 returned error can't find the container with id f4abacb4ca1407bfc1269f4a57ff265ac094e72a63d96a07d0cff8dbda3595a9 Jun 03 19:36:15.693702 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.693667 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:15.860158 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:15.860120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" event={"ID":"ea6ca8ef-b85a-416b-843d-fad3d3b51b96","Type":"ContainerStarted","Data":"f4abacb4ca1407bfc1269f4a57ff265ac094e72a63d96a07d0cff8dbda3595a9"} Jun 03 19:36:18.890638 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:18.890590 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:36:18.890954 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:18.890677 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:36:19.615705 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.615655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:19.716344 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.716308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:19.880391 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.880318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" event={"ID":"ea6ca8ef-b85a-416b-843d-fad3d3b51b96","Type":"ContainerStarted","Data":"86777322c05149eb2bf507ce54dc258c116594e7d2f642d431d6aad477692706"} Jun 03 19:36:19.880697 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.880677 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:19.882395 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.882370 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-mz8hd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 19:36:19.882526 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.882417 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" podUID="ea6ca8ef-b85a-416b-843d-fad3d3b51b96" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:36:19.917167 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.917123 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" podStartSLOduration=1.624537051 podStartE2EDuration="4.917108749s" totalImagesPullingTime="3.292571698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:19.915520879 +0000 UTC m=+423.309045786" watchObservedRunningTime="2026-06-03 19:36:19.917108749 +0000 UTC m=+423.310633655" Jun 03 19:36:19.942742 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:19.942701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:20.150974 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:20.150892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:20.266918 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:20.266877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:20.886062 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:20.886032 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mz8hd" Jun 03 19:36:21.249500 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:21.249468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:25.762971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:25.762936 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:26.885706 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:26.885677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:26.996030 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:26.995974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:27.111788 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:27.111755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:36.284946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:36.284908 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:36.338331 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:36.338259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:55.649439 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:55.649408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:59.319983 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:36:59.319948 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:00.652946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:00.652894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.054973 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:01.054941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:02.147443 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:02.147412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:02.249489 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:02.249455 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:03.681316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:03.681280 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:03.770162 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:03.770116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:05.287191 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.287158 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c"] Jun 03 19:37:05.297403 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.297378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:05.300201 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.300181 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 19:37:05.300325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.300218 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sfmhd\"" Jun 03 19:37:05.300949 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.300931 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:37:05.301029 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.300992 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:37:05.308220 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.308199 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c"] Jun 03 19:37:05.354279 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.354258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnk9d\" (UniqueName: \"kubernetes.io/projected/e526bd53-a373-4308-b94c-47779caee048-kube-api-access-vnk9d\") pod \"dns-operator-controller-manager-864dd78c4c-qqh5c\" (UID: \"e526bd53-a373-4308-b94c-47779caee048\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:05.455210 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.455183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnk9d\" (UniqueName: \"kubernetes.io/projected/e526bd53-a373-4308-b94c-47779caee048-kube-api-access-vnk9d\") pod \"dns-operator-controller-manager-864dd78c4c-qqh5c\" (UID: \"e526bd53-a373-4308-b94c-47779caee048\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:05.471373 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.471351 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnk9d\" (UniqueName: \"kubernetes.io/projected/e526bd53-a373-4308-b94c-47779caee048-kube-api-access-vnk9d\") pod \"dns-operator-controller-manager-864dd78c4c-qqh5c\" (UID: \"e526bd53-a373-4308-b94c-47779caee048\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:05.608256 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.608175 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:05.738720 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.738688 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c"] Jun 03 19:37:05.742060 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:37:05.742036 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode526bd53_a373_4308_b94c_47779caee048.slice/crio-bfebecd67aa4f77a4e3caedce1fb6ec6db145c94c141730f8f8a8caf91a8a354 WatchSource:0}: Error finding container bfebecd67aa4f77a4e3caedce1fb6ec6db145c94c141730f8f8a8caf91a8a354: Status 404 returned error can't find the container with id bfebecd67aa4f77a4e3caedce1fb6ec6db145c94c141730f8f8a8caf91a8a354 Jun 03 19:37:05.863529 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:05.863426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:06.084280 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:06.084246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" event={"ID":"e526bd53-a373-4308-b94c-47779caee048","Type":"ContainerStarted","Data":"bfebecd67aa4f77a4e3caedce1fb6ec6db145c94c141730f8f8a8caf91a8a354"} Jun 03 19:37:07.724642 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:07.724601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:08.094910 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:08.094877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" event={"ID":"e526bd53-a373-4308-b94c-47779caee048","Type":"ContainerStarted","Data":"17bc35cad2a2485e613f96d128d93ddafedbf532f6bc85902f17a9fc628e40cd"} Jun 03 19:37:09.099268 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:09.099238 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:09.120728 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:09.120682 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" podStartSLOduration=1.8416345920000001 podStartE2EDuration="4.120667758s" totalImagesPullingTime="2.279033166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:09.1190317 +0000 UTC m=+472.512556608" watchObservedRunningTime="2026-06-03 19:37:09.120667758 +0000 UTC m=+472.514192666" Jun 03 19:37:09.670535 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:09.670498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:09.746886 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:09.746830 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:09.837267 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:09.837230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:10.050961 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:10.050929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:19.910739 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:19.910706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:20.011286 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.011248 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:20.106374 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.106349 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqh5c" Jun 03 19:37:20.110155 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.110131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:20.256302 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.256266 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:20.262529 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.262507 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.264926 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.264908 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngf6h\"" Jun 03 19:37:20.274256 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.274236 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:20.374450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.374419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p6g\" (UniqueName: \"kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.374623 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.374456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.475293 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.475249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.475481 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.475383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p6g\" (UniqueName: \"kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.475680 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.475658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.484118 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.484094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p6g\" (UniqueName: \"kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7f4j\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.574351 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.574266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:20.737207 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:20.737178 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:20.737988 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:37:20.737962 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b3ba0f_398f_4b01_ac42_7949a8767b1a.slice/crio-ed874638959a91276ab8df89b06c6f193bea1d92d641d855586db73b5965e926 WatchSource:0}: Error finding container ed874638959a91276ab8df89b06c6f193bea1d92d641d855586db73b5965e926: Status 404 returned error can't find the container with id ed874638959a91276ab8df89b06c6f193bea1d92d641d855586db73b5965e926 Jun 03 19:37:21.156084 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:21.156047 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" event={"ID":"18b3ba0f-398f-4b01-ac42-7949a8767b1a","Type":"ContainerStarted","Data":"ed874638959a91276ab8df89b06c6f193bea1d92d641d855586db73b5965e926"} Jun 03 19:37:22.320398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:22.320355 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:22.431990 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:22.431946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:25.179288 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:25.179254 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" event={"ID":"18b3ba0f-398f-4b01-ac42-7949a8767b1a","Type":"ContainerStarted","Data":"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13"} Jun 03 19:37:25.179715 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:25.179351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:25.200057 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:25.200013 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" podStartSLOduration=0.867125666 podStartE2EDuration="5.19999896s" totalImagesPullingTime="4.332873294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:25.198962025 +0000 UTC m=+488.592486944" watchObservedRunningTime="2026-06-03 19:37:25.19999896 +0000 UTC m=+488.593523868" Jun 03 19:37:27.082051 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:27.082010 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:27.184651 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:27.184614 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:30.870113 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:30.870079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:30.971530 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:30.971494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:36.186522 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:36.186489 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:39.595483 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:39.595446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:39.741466 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:39.741429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:39.838460 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:39.838417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:41.993897 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:41.993839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:42.093765 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:42.093726 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:46.752870 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:46.752807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:46.853042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:46.853003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:47.036064 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.035963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:47.110921 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.110888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:47.621208 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.621180 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:47.621395 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.621368 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" podUID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" containerName="manager" containerID="cri-o://08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13" gracePeriod=10 Jun 03 19:37:47.878401 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.878341 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:47.986734 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.986700 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume\") pod \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " Jun 03 19:37:47.986922 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.986741 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95p6g\" (UniqueName: \"kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g\") pod \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\" (UID: \"18b3ba0f-398f-4b01-ac42-7949a8767b1a\") " Jun 03 19:37:47.987130 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.987108 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "18b3ba0f-398f-4b01-ac42-7949a8767b1a" (UID: "18b3ba0f-398f-4b01-ac42-7949a8767b1a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:37:47.988881 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:47.988860 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g" (OuterVolumeSpecName: "kube-api-access-95p6g") pod "18b3ba0f-398f-4b01-ac42-7949a8767b1a" (UID: "18b3ba0f-398f-4b01-ac42-7949a8767b1a"). InnerVolumeSpecName "kube-api-access-95p6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:37:48.088192 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.088165 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18b3ba0f-398f-4b01-ac42-7949a8767b1a-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:37:48.088192 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.088188 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95p6g\" (UniqueName: \"kubernetes.io/projected/18b3ba0f-398f-4b01-ac42-7949a8767b1a-kube-api-access-95p6g\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:37:48.287365 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.287336 2558 generic.go:356] "Generic (PLEG): container finished" podID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" containerID="08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13" exitCode=0 Jun 03 19:37:48.287499 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.287388 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" Jun 03 19:37:48.287499 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.287412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" event={"ID":"18b3ba0f-398f-4b01-ac42-7949a8767b1a","Type":"ContainerDied","Data":"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13"} Jun 03 19:37:48.287499 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.287470 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j" event={"ID":"18b3ba0f-398f-4b01-ac42-7949a8767b1a","Type":"ContainerDied","Data":"ed874638959a91276ab8df89b06c6f193bea1d92d641d855586db73b5965e926"} Jun 03 19:37:48.287615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.287499 2558 scope.go:117] "RemoveContainer" containerID="08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13" Jun 03 19:37:48.296723 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.296709 2558 scope.go:117] "RemoveContainer" containerID="08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13" Jun 03 19:37:48.296965 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:37:48.296945 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13\": container with ID starting with 08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13 not found: ID does not exist" containerID="08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13" Jun 03 19:37:48.297038 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.296977 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13"} err="failed to get container status \"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13\": rpc error: code = NotFound desc = could not find container \"08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13\": container with ID starting with 08a9ffb2788d3ab654fb58f98dde33b12568f73dc0b8ce22f49074a8f8f4db13 not found: ID does not exist" Jun 03 19:37:48.312554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.312531 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:48.316434 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:48.316413 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7f4j"] Jun 03 19:37:49.108835 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:49.108808 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" path="/var/lib/kubelet/pods/18b3ba0f-398f-4b01-ac42-7949a8767b1a/volumes" Jun 03 19:37:50.761542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:50.761500 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:50.870843 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:37:50.870802 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:00.958519 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:00.958473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:01.025469 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:01.025433 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:01.190074 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:01.190030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:01.285605 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:01.285569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:02.749534 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:02.749498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:02.815242 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:02.815205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:03.957803 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.957771 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8"] Jun 03 19:38:03.958272 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.958255 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" containerName="manager" Jun 03 19:38:03.958337 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.958275 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" containerName="manager" Jun 03 19:38:03.958410 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.958391 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b3ba0f-398f-4b01-ac42-7949a8767b1a" containerName="manager" Jun 03 19:38:03.963909 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.963885 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:03.966225 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.966200 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hg4xj\"" Jun 03 19:38:03.976656 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:03.976335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8"] Jun 03 19:38:04.007813 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.007782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:04.015879 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.015833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.015920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.015963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.015982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-988pq\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-kube-api-access-988pq\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.016004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016163 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.016024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636253d1-ba5b-44ae-b302-bbf69ec50227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016163 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.016091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016163 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.016131 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.016275 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.016168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.115223 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.115185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117255 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-988pq\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-kube-api-access-988pq\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636253d1-ba5b-44ae-b302-bbf69ec50227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.117540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.118195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.118650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.119246 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636253d1-ba5b-44ae-b302-bbf69ec50227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.119457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.120071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.119699 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.123402 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.123377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.124298 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.124269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.126840 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.126812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.127281 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.127261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-988pq\" (UniqueName: \"kubernetes.io/projected/636253d1-ba5b-44ae-b302-bbf69ec50227-kube-api-access-988pq\") pod \"maas-default-gateway-openshift-default-687ff6996-7r2q8\" (UID: \"636253d1-ba5b-44ae-b302-bbf69ec50227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.280294 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.280260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:04.430552 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:04.430527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8"] Jun 03 19:38:04.432622 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:38:04.432596 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636253d1_ba5b_44ae_b302_bbf69ec50227.slice/crio-be974de2577e3aa751277b36b98d5cc872e421e4f3730bfc95cebddc2b418bc7 WatchSource:0}: Error finding container be974de2577e3aa751277b36b98d5cc872e421e4f3730bfc95cebddc2b418bc7: Status 404 returned error can't find the container with id be974de2577e3aa751277b36b98d5cc872e421e4f3730bfc95cebddc2b418bc7 Jun 03 19:38:05.366981 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:05.366945 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" event={"ID":"636253d1-ba5b-44ae-b302-bbf69ec50227","Type":"ContainerStarted","Data":"be974de2577e3aa751277b36b98d5cc872e421e4f3730bfc95cebddc2b418bc7"} Jun 03 19:38:07.181546 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:07.181463 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:07.276053 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:07.276019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:07.520973 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:07.520941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:08.646526 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:08.646493 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:38:08.646791 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:08.646559 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:38:08.646791 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:08.646590 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:38:09.388566 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:09.388535 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" event={"ID":"636253d1-ba5b-44ae-b302-bbf69ec50227","Type":"ContainerStarted","Data":"4928096bfaf4680654ceac3614ccb7e828600c213e2436dd506416f848b140d5"} Jun 03 19:38:09.415734 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:09.415685 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" podStartSLOduration=2.204101427 podStartE2EDuration="6.41567053s" totalImagesPullingTime="4.211569103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:38:09.413226389 +0000 UTC m=+532.806751296" watchObservedRunningTime="2026-06-03 19:38:09.41567053 +0000 UTC m=+532.809195438" Jun 03 19:38:10.280873 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:10.280821 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:10.285346 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:10.285323 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:10.393673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:10.393642 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:10.394516 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:10.394497 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:38:50.689021 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:50.688978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:50.790257 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:38:50.790213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:11.994294 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:11.994258 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-qd897"] Jun 03 19:39:11.998070 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:11.998049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.000264 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.000245 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 19:39:12.004170 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.004146 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-qd897"] Jun 03 19:39:12.025731 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.025705 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:12.099227 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.099193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hxk\" (UniqueName: \"kubernetes.io/projected/3d7b73ea-0d98-4250-87a4-5d277076f155-kube-api-access-47hxk\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.099398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.099292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d7b73ea-0d98-4250-87a4-5d277076f155-data\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.200654 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.200621 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d7b73ea-0d98-4250-87a4-5d277076f155-data\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.200822 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.200677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hxk\" (UniqueName: \"kubernetes.io/projected/3d7b73ea-0d98-4250-87a4-5d277076f155-kube-api-access-47hxk\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.201049 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.201028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d7b73ea-0d98-4250-87a4-5d277076f155-data\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.211129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.211109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hxk\" (UniqueName: \"kubernetes.io/projected/3d7b73ea-0d98-4250-87a4-5d277076f155-kube-api-access-47hxk\") pod \"postgres-69fb4594cf-qd897\" (UID: \"3d7b73ea-0d98-4250-87a4-5d277076f155\") " pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.309689 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.309669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:12.436815 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.436658 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-qd897"] Jun 03 19:39:12.439151 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:39:12.439122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7b73ea_0d98_4250_87a4_5d277076f155.slice/crio-e7eac2bf8aa8b0911a88815beef1e5bd3ae44678adf75f46c73de63413d28071 WatchSource:0}: Error finding container e7eac2bf8aa8b0911a88815beef1e5bd3ae44678adf75f46c73de63413d28071: Status 404 returned error can't find the container with id e7eac2bf8aa8b0911a88815beef1e5bd3ae44678adf75f46c73de63413d28071 Jun 03 19:39:12.685456 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:12.685387 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-qd897" event={"ID":"3d7b73ea-0d98-4250-87a4-5d277076f155","Type":"ContainerStarted","Data":"e7eac2bf8aa8b0911a88815beef1e5bd3ae44678adf75f46c73de63413d28071"} Jun 03 19:39:14.458018 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:14.457939 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:15.701681 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:15.701597 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-qd897" event={"ID":"3d7b73ea-0d98-4250-87a4-5d277076f155","Type":"ContainerStarted","Data":"4ec068d6773536e23169214936d7db0db25a27358ce4d7a2ee191dbd2044f862"} Jun 03 19:39:15.702072 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:15.701736 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:15.719511 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:15.719464 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-qd897" podStartSLOduration=1.748674742 podStartE2EDuration="4.719449166s" totalImagesPullingTime="2.970774424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:15.717575948 +0000 UTC m=+599.111100855" watchObservedRunningTime="2026-06-03 19:39:15.719449166 +0000 UTC m=+599.112974073" Jun 03 19:39:21.736023 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:21.735992 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-qd897" Jun 03 19:39:22.041675 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:22.041620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:22.142020 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:22.141991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:22.381901 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:22.381798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:46.079488 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:46.079385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:46.180908 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:46.180867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:55.457902 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:39:55.457864 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:16.458896 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.458840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:16.664633 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.664598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:16.675568 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.675543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:16.678966 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.678951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.681300 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.681276 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:40:16.681422 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.681360 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x7vrp\"" Jun 03 19:40:16.689730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.689703 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:16.773999 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.773970 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:16.787005 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.786977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:16.847043 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.847009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.847043 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.847050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4f86\" (UniqueName: \"kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.899128 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.899092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:16.947801 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.947764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.948005 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.947814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4f86\" (UniqueName: \"kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.948414 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.948392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.959017 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.958993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4f86\" (UniqueName: \"kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86\") pod \"limitador-limitador-64c94fd64f-mhrdp\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:16.989411 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:16.989381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:17.136168 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:17.136146 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:17.137889 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:40:17.137840 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5916fbc_687f_4acc_a9f0_7fa1834889ff.slice/crio-5ff549418f267c9b32728135123e875892229bbdab1446606b9a5189e68702c3 WatchSource:0}: Error finding container 5ff549418f267c9b32728135123e875892229bbdab1446606b9a5189e68702c3: Status 404 returned error can't find the container with id 5ff549418f267c9b32728135123e875892229bbdab1446606b9a5189e68702c3 Jun 03 19:40:17.139768 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:17.139750 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:40:17.725552 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:17.725513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:17.791623 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:17.791469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:18.002360 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:18.002292 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" event={"ID":"d5916fbc-687f-4acc-a9f0-7fa1834889ff","Type":"ContainerStarted","Data":"5ff549418f267c9b32728135123e875892229bbdab1446606b9a5189e68702c3"} Jun 03 19:40:20.020718 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:20.020681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" event={"ID":"d5916fbc-687f-4acc-a9f0-7fa1834889ff","Type":"ContainerStarted","Data":"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c"} Jun 03 19:40:20.021090 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:20.020759 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:20.039864 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:20.039817 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" podStartSLOduration=1.255216921 podStartE2EDuration="4.039803918s" totalImagesPullingTime="2.784586997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:20.037616886 +0000 UTC m=+663.431141793" watchObservedRunningTime="2026-06-03 19:40:20.039803918 +0000 UTC m=+663.433328849" Jun 03 19:40:21.741798 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:21.741768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:21.991723 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:21.991691 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:21.995829 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:21.995557 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:21.998148 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:21.998128 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wl4tz\"" Jun 03 19:40:22.003787 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.003765 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:22.037585 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.037554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:22.085792 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.085761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48\") pod \"authorino-5d4b67c446-79bb4\" (UID: \"af82dbde-bc39-442a-aa1d-21385aea8d10\") " pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:22.187052 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.187018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48\") pod \"authorino-5d4b67c446-79bb4\" (UID: \"af82dbde-bc39-442a-aa1d-21385aea8d10\") " pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:22.198303 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.198272 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48\") pod \"authorino-5d4b67c446-79bb4\" (UID: \"af82dbde-bc39-442a-aa1d-21385aea8d10\") " pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:22.216395 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.216358 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:22.216643 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.216613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:22.347065 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:22.347042 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:22.348940 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:40:22.348903 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf82dbde_bc39_442a_aa1d_21385aea8d10.slice/crio-d8fffd049978f5b728848abb338f71f2792a2ea5129d33e834ecfc89f4e63ef7 WatchSource:0}: Error finding container d8fffd049978f5b728848abb338f71f2792a2ea5129d33e834ecfc89f4e63ef7: Status 404 returned error can't find the container with id d8fffd049978f5b728848abb338f71f2792a2ea5129d33e834ecfc89f4e63ef7 Jun 03 19:40:23.040397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:23.040357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-79bb4" event={"ID":"af82dbde-bc39-442a-aa1d-21385aea8d10","Type":"ContainerStarted","Data":"d8fffd049978f5b728848abb338f71f2792a2ea5129d33e834ecfc89f4e63ef7"} Jun 03 19:40:26.057094 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.057060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-79bb4" event={"ID":"af82dbde-bc39-442a-aa1d-21385aea8d10","Type":"ContainerStarted","Data":"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f"} Jun 03 19:40:26.057094 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.057088 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-79bb4" podUID="af82dbde-bc39-442a-aa1d-21385aea8d10" containerName="authorino" containerID="cri-o://805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f" gracePeriod=30 Jun 03 19:40:26.078604 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.078563 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-79bb4" podStartSLOduration=2.370923497 podStartE2EDuration="5.078549229s" totalImagesPullingTime="2.707625732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:26.07797476 +0000 UTC m=+669.471499684" watchObservedRunningTime="2026-06-03 19:40:26.078549229 +0000 UTC m=+669.472074137" Jun 03 19:40:26.303552 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.303518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:26.307740 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.307690 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:26.419457 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.419418 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48\") pod \"af82dbde-bc39-442a-aa1d-21385aea8d10\" (UID: \"af82dbde-bc39-442a-aa1d-21385aea8d10\") " Jun 03 19:40:26.421468 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.421438 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48" (OuterVolumeSpecName: "kube-api-access-m2c48") pod "af82dbde-bc39-442a-aa1d-21385aea8d10" (UID: "af82dbde-bc39-442a-aa1d-21385aea8d10"). InnerVolumeSpecName "kube-api-access-m2c48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:26.521067 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:26.521036 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/af82dbde-bc39-442a-aa1d-21385aea8d10-kube-api-access-m2c48\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:40:27.063191 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.063160 2558 generic.go:356] "Generic (PLEG): container finished" podID="af82dbde-bc39-442a-aa1d-21385aea8d10" containerID="805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f" exitCode=0 Jun 03 19:40:27.063629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.063203 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-79bb4" Jun 03 19:40:27.063629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.063242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-79bb4" event={"ID":"af82dbde-bc39-442a-aa1d-21385aea8d10","Type":"ContainerDied","Data":"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f"} Jun 03 19:40:27.063629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.063281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-79bb4" event={"ID":"af82dbde-bc39-442a-aa1d-21385aea8d10","Type":"ContainerDied","Data":"d8fffd049978f5b728848abb338f71f2792a2ea5129d33e834ecfc89f4e63ef7"} Jun 03 19:40:27.063629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.063298 2558 scope.go:117] "RemoveContainer" containerID="805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f" Jun 03 19:40:27.071823 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.071808 2558 scope.go:117] "RemoveContainer" containerID="805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f" Jun 03 19:40:27.072099 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:40:27.072082 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f\": container with ID starting with 805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f not found: ID does not exist" containerID="805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f" Jun 03 19:40:27.072149 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.072109 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f"} err="failed to get container status \"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f\": rpc error: code = NotFound desc = could not find container \"805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f\": container with ID starting with 805f59005a52e4caa2741622cfa234c354a59a53ac1ea866c065374c07ddae9f not found: ID does not exist" Jun 03 19:40:27.086814 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.086787 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:27.096532 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.096511 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-79bb4"] Jun 03 19:40:27.110582 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:27.110559 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af82dbde-bc39-442a-aa1d-21385aea8d10" path="/var/lib/kubelet/pods/af82dbde-bc39-442a-aa1d-21385aea8d10/volumes" Jun 03 19:40:29.622133 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.622095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.646176 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.646145 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:29.646493 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.646481 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af82dbde-bc39-442a-aa1d-21385aea8d10" containerName="authorino" Jun 03 19:40:29.646536 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.646495 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="af82dbde-bc39-442a-aa1d-21385aea8d10" containerName="authorino" Jun 03 19:40:29.646569 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.646554 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="af82dbde-bc39-442a-aa1d-21385aea8d10" containerName="authorino" Jun 03 19:40:29.650910 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.650889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.653574 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.653551 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 03 19:40:29.653690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.653614 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qgjb\"" Jun 03 19:40:29.653690 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.653636 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:40:29.661986 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.661966 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:29.741635 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.741605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.751730 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.751695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdfw\" (UniqueName: \"kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.751897 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.751751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.806635 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.806595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.842773 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.842747 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:40:29.846120 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.846101 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:29.852424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.852403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.852556 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.852462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdfw\" (UniqueName: \"kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.855058 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.855038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.867364 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.867342 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:40:29.869397 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.869373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdfw\" (UniqueName: \"kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw\") pod \"maas-controller-654cf79cd9-87w5c\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:29.953681 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.953586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:29.953840 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.953705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkst5\" (UniqueName: \"kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:29.961667 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:29.961633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:30.055047 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.055016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:30.055204 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.055115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkst5\" (UniqueName: \"kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:30.057584 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.057556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:30.064777 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.064750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkst5\" (UniqueName: \"kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5\") pod \"maas-controller-f88c8c74d-5fl66\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:30.094915 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.094890 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:30.096722 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:40:30.096697 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae984aea_42b6_482d_bafd_2d50eb86c72f.slice/crio-a3d762eb758edcaa3810f6c601ba46f88d55f1cc8fe1971a960cfd6d2398e972 WatchSource:0}: Error finding container a3d762eb758edcaa3810f6c601ba46f88d55f1cc8fe1971a960cfd6d2398e972: Status 404 returned error can't find the container with id a3d762eb758edcaa3810f6c601ba46f88d55f1cc8fe1971a960cfd6d2398e972 Jun 03 19:40:30.156118 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.156086 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:30.287939 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:30.287916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:40:30.289949 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:40:30.289910 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd401ba14_dc9c_4bb1_b9e1_901a184c8a62.slice/crio-1d9953730a9970d35f67a08153cd0b9b5a23472e73b93490ced60a38997c0665 WatchSource:0}: Error finding container 1d9953730a9970d35f67a08153cd0b9b5a23472e73b93490ced60a38997c0665: Status 404 returned error can't find the container with id 1d9953730a9970d35f67a08153cd0b9b5a23472e73b93490ced60a38997c0665 Jun 03 19:40:31.027714 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:31.027683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:31.104558 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:31.099729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654cf79cd9-87w5c" event={"ID":"ae984aea-42b6-482d-bafd-2d50eb86c72f","Type":"ContainerStarted","Data":"a3d762eb758edcaa3810f6c601ba46f88d55f1cc8fe1971a960cfd6d2398e972"} Jun 03 19:40:31.104558 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:31.102458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-5fl66" event={"ID":"d401ba14-dc9c-4bb1-b9e1-901a184c8a62","Type":"ContainerStarted","Data":"1d9953730a9970d35f67a08153cd0b9b5a23472e73b93490ced60a38997c0665"} Jun 03 19:40:31.434813 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:31.434710 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:31.435042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:31.435012 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" podUID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" containerName="limitador" containerID="cri-o://feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c" gracePeriod=30 Jun 03 19:40:32.636761 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.636737 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:32.676558 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.676525 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4f86\" (UniqueName: \"kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86\") pod \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " Jun 03 19:40:32.676700 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.676614 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file\") pod \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\" (UID: \"d5916fbc-687f-4acc-a9f0-7fa1834889ff\") " Jun 03 19:40:32.677165 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.677127 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file" (OuterVolumeSpecName: "config-file") pod "d5916fbc-687f-4acc-a9f0-7fa1834889ff" (UID: "d5916fbc-687f-4acc-a9f0-7fa1834889ff"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:40:32.678640 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.678599 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86" (OuterVolumeSpecName: "kube-api-access-l4f86") pod "d5916fbc-687f-4acc-a9f0-7fa1834889ff" (UID: "d5916fbc-687f-4acc-a9f0-7fa1834889ff"). InnerVolumeSpecName "kube-api-access-l4f86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:32.777617 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.777578 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5916fbc-687f-4acc-a9f0-7fa1834889ff-config-file\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:40:32.777617 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.777607 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4f86\" (UniqueName: \"kubernetes.io/projected/d5916fbc-687f-4acc-a9f0-7fa1834889ff-kube-api-access-l4f86\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:40:32.889728 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.889631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:32.977788 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:32.977755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:33.114758 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.114564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-5fl66" event={"ID":"d401ba14-dc9c-4bb1-b9e1-901a184c8a62","Type":"ContainerStarted","Data":"7885f299281c9ebf1254ed2d68353854abb65939294f507b57b1e1d0d3e0fb8a"} Jun 03 19:40:33.114758 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.114643 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:33.116049 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.116022 2558 generic.go:356] "Generic (PLEG): container finished" podID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" containerID="feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c" exitCode=0 Jun 03 19:40:33.116181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.116056 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" Jun 03 19:40:33.116181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.116110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" event={"ID":"d5916fbc-687f-4acc-a9f0-7fa1834889ff","Type":"ContainerDied","Data":"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c"} Jun 03 19:40:33.116181 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.116164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrdp" event={"ID":"d5916fbc-687f-4acc-a9f0-7fa1834889ff","Type":"ContainerDied","Data":"5ff549418f267c9b32728135123e875892229bbdab1446606b9a5189e68702c3"} Jun 03 19:40:33.116351 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.116195 2558 scope.go:117] "RemoveContainer" containerID="feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c" Jun 03 19:40:33.118402 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.118348 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654cf79cd9-87w5c" event={"ID":"ae984aea-42b6-482d-bafd-2d50eb86c72f","Type":"ContainerStarted","Data":"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18"} Jun 03 19:40:33.118590 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.118550 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:33.126150 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.126135 2558 scope.go:117] "RemoveContainer" containerID="feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c" Jun 03 19:40:33.126414 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:40:33.126396 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c\": container with ID starting with feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c not found: ID does not exist" containerID="feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c" Jun 03 19:40:33.126471 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.126420 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c"} err="failed to get container status \"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c\": rpc error: code = NotFound desc = could not find container \"feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c\": container with ID starting with feae8e953b43c10005ea928d23794117f6d3f21c1d61a1e3a41675f23dadbd2c not found: ID does not exist" Jun 03 19:40:33.139496 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.139454 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f88c8c74d-5fl66" podStartSLOduration=1.738183794 podStartE2EDuration="4.139441082s" totalImagesPullingTime="2.401257288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:33.137417246 +0000 UTC m=+676.530942152" watchObservedRunningTime="2026-06-03 19:40:33.139441082 +0000 UTC m=+676.532965981" Jun 03 19:40:33.152706 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.152649 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:33.158038 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.158012 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrdp"] Jun 03 19:40:33.174279 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:33.174231 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-654cf79cd9-87w5c" podStartSLOduration=1.587056185 podStartE2EDuration="4.174213705s" totalImagesPullingTime="2.58715752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:33.173603563 +0000 UTC m=+676.567128470" watchObservedRunningTime="2026-06-03 19:40:33.174213705 +0000 UTC m=+676.567738612" Jun 03 19:40:35.109138 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:35.109100 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" path="/var/lib/kubelet/pods/d5916fbc-687f-4acc-a9f0-7fa1834889ff/volumes" Jun 03 19:40:44.129366 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.129338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:44.129748 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.129401 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:40:44.194362 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.194329 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:44.194618 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.194566 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-654cf79cd9-87w5c" podUID="ae984aea-42b6-482d-bafd-2d50eb86c72f" containerName="manager" containerID="cri-o://87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18" gracePeriod=30 Jun 03 19:40:44.443165 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.443141 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:44.474416 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.474389 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert\") pod \"ae984aea-42b6-482d-bafd-2d50eb86c72f\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " Jun 03 19:40:44.474552 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.474426 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsdfw\" (UniqueName: \"kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw\") pod \"ae984aea-42b6-482d-bafd-2d50eb86c72f\" (UID: \"ae984aea-42b6-482d-bafd-2d50eb86c72f\") " Jun 03 19:40:44.476507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.476472 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae984aea-42b6-482d-bafd-2d50eb86c72f" (UID: "ae984aea-42b6-482d-bafd-2d50eb86c72f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:40:44.476605 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.476547 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw" (OuterVolumeSpecName: "kube-api-access-wsdfw") pod "ae984aea-42b6-482d-bafd-2d50eb86c72f" (UID: "ae984aea-42b6-482d-bafd-2d50eb86c72f"). InnerVolumeSpecName "kube-api-access-wsdfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:44.575754 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.575719 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae984aea-42b6-482d-bafd-2d50eb86c72f-webhook-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:40:44.575754 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:44.575745 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsdfw\" (UniqueName: \"kubernetes.io/projected/ae984aea-42b6-482d-bafd-2d50eb86c72f-kube-api-access-wsdfw\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:40:45.178971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.178940 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae984aea-42b6-482d-bafd-2d50eb86c72f" containerID="87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18" exitCode=0 Jun 03 19:40:45.179435 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.178994 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654cf79cd9-87w5c" Jun 03 19:40:45.179435 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.179036 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654cf79cd9-87w5c" event={"ID":"ae984aea-42b6-482d-bafd-2d50eb86c72f","Type":"ContainerDied","Data":"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18"} Jun 03 19:40:45.179435 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.179090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654cf79cd9-87w5c" event={"ID":"ae984aea-42b6-482d-bafd-2d50eb86c72f","Type":"ContainerDied","Data":"a3d762eb758edcaa3810f6c601ba46f88d55f1cc8fe1971a960cfd6d2398e972"} Jun 03 19:40:45.179435 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.179118 2558 scope.go:117] "RemoveContainer" containerID="87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18" Jun 03 19:40:45.187496 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.187478 2558 scope.go:117] "RemoveContainer" containerID="87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18" Jun 03 19:40:45.187765 ip-10-0-136-174 kubenswrapper[2558]: E0603 19:40:45.187745 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18\": container with ID starting with 87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18 not found: ID does not exist" containerID="87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18" Jun 03 19:40:45.187834 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.187777 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18"} err="failed to get container status \"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18\": rpc error: code = NotFound desc = could not find container \"87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18\": container with ID starting with 87b5bd47dc886424e3e432dd91676819611082deaf5d1d7eaa61085987089f18 not found: ID does not exist" Jun 03 19:40:45.206483 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.206458 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:45.211183 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:45.211162 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-654cf79cd9-87w5c"] Jun 03 19:40:47.109403 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:40:47.109370 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae984aea-42b6-482d-bafd-2d50eb86c72f" path="/var/lib/kubelet/pods/ae984aea-42b6-482d-bafd-2d50eb86c72f/volumes" Jun 03 19:41:03.954184 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:03.954149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:04.012661 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.012632 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5b445447cd-q65s4"] Jun 03 19:41:04.012981 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.012970 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" containerName="limitador" Jun 03 19:41:04.013042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.012983 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" containerName="limitador" Jun 03 19:41:04.013042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.013002 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae984aea-42b6-482d-bafd-2d50eb86c72f" containerName="manager" Jun 03 19:41:04.013042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.013007 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae984aea-42b6-482d-bafd-2d50eb86c72f" containerName="manager" Jun 03 19:41:04.013130 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.013064 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae984aea-42b6-482d-bafd-2d50eb86c72f" containerName="manager" Jun 03 19:41:04.013130 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.013071 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5916fbc-687f-4acc-a9f0-7fa1834889ff" containerName="limitador" Jun 03 19:41:04.021176 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.021149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.023531 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.023512 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sf4qk\"" Jun 03 19:41:04.024610 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.024587 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 19:41:04.027280 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.027256 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b445447cd-q65s4"] Jun 03 19:41:04.060066 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.060033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:04.150275 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.150244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chv69\" (UniqueName: \"kubernetes.io/projected/88f98f0d-9926-433e-adab-c592a4eb03d7-kube-api-access-chv69\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.150275 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.150277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f98f0d-9926-433e-adab-c592a4eb03d7-maas-api-tls\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.251601 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.251576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chv69\" (UniqueName: \"kubernetes.io/projected/88f98f0d-9926-433e-adab-c592a4eb03d7-kube-api-access-chv69\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.251769 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.251610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f98f0d-9926-433e-adab-c592a4eb03d7-maas-api-tls\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.253971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.253950 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f98f0d-9926-433e-adab-c592a4eb03d7-maas-api-tls\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.262987 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.262965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chv69\" (UniqueName: \"kubernetes.io/projected/88f98f0d-9926-433e-adab-c592a4eb03d7-kube-api-access-chv69\") pod \"maas-api-5b445447cd-q65s4\" (UID: \"88f98f0d-9926-433e-adab-c592a4eb03d7\") " pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.333502 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.333475 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:04.467650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.467628 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b445447cd-q65s4"] Jun 03 19:41:04.469586 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:41:04.469559 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f98f0d_9926_433e_adab_c592a4eb03d7.slice/crio-888a64ae007bd2672beee34d4f03653e60df754c6c26118055a13b924ca48d40 WatchSource:0}: Error finding container 888a64ae007bd2672beee34d4f03653e60df754c6c26118055a13b924ca48d40: Status 404 returned error can't find the container with id 888a64ae007bd2672beee34d4f03653e60df754c6c26118055a13b924ca48d40 Jun 03 19:41:04.475042 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.475018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:04.545542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.545464 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q45js"] Jun 03 19:41:04.549787 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.549766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:04.552836 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.552815 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 19:41:04.553188 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.553173 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rsjqm\"" Jun 03 19:41:04.558371 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.558350 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q45js"] Jun 03 19:41:04.654610 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.654579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqvz6\" (UniqueName: \"kubernetes.io/projected/ecc0f45e-61aa-4180-961d-dae9f1a0facf-kube-api-access-kqvz6\") pod \"payload-processing-7c6c859784-q45js\" (UID: \"ecc0f45e-61aa-4180-961d-dae9f1a0facf\") " pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:04.756043 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.755987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqvz6\" (UniqueName: \"kubernetes.io/projected/ecc0f45e-61aa-4180-961d-dae9f1a0facf-kube-api-access-kqvz6\") pod \"payload-processing-7c6c859784-q45js\" (UID: \"ecc0f45e-61aa-4180-961d-dae9f1a0facf\") " pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:04.764220 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.764196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqvz6\" (UniqueName: \"kubernetes.io/projected/ecc0f45e-61aa-4180-961d-dae9f1a0facf-kube-api-access-kqvz6\") pod \"payload-processing-7c6c859784-q45js\" (UID: \"ecc0f45e-61aa-4180-961d-dae9f1a0facf\") " pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:04.860907 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:04.860814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:05.010541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:05.010494 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q45js"] Jun 03 19:41:05.012599 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:41:05.012576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc0f45e_61aa_4180_961d_dae9f1a0facf.slice/crio-43848fb9d6b892ccab35a262dff9503ed2c501787d393072b334409a4d4f781e WatchSource:0}: Error finding container 43848fb9d6b892ccab35a262dff9503ed2c501787d393072b334409a4d4f781e: Status 404 returned error can't find the container with id 43848fb9d6b892ccab35a262dff9503ed2c501787d393072b334409a4d4f781e Jun 03 19:41:05.281552 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:05.281511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b445447cd-q65s4" event={"ID":"88f98f0d-9926-433e-adab-c592a4eb03d7","Type":"ContainerStarted","Data":"888a64ae007bd2672beee34d4f03653e60df754c6c26118055a13b924ca48d40"} Jun 03 19:41:05.283017 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:05.282988 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-q45js" event={"ID":"ecc0f45e-61aa-4180-961d-dae9f1a0facf","Type":"ContainerStarted","Data":"43848fb9d6b892ccab35a262dff9503ed2c501787d393072b334409a4d4f781e"} Jun 03 19:41:06.654012 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:06.653978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:07.308594 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:07.308553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b445447cd-q65s4" event={"ID":"88f98f0d-9926-433e-adab-c592a4eb03d7","Type":"ContainerStarted","Data":"e4eeec7b6e23599d89068134fd39ceaae0161c16c91a578ad7770e9dda7e45a3"} Jun 03 19:41:07.308774 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:07.308712 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:07.326683 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:07.326267 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5b445447cd-q65s4" podStartSLOduration=2.29808907 podStartE2EDuration="4.326251523s" totalImagesPullingTime="2.028162453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:07.325417048 +0000 UTC m=+710.718941989" watchObservedRunningTime="2026-06-03 19:41:07.326251523 +0000 UTC m=+710.719776430" Jun 03 19:41:07.796373 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:07.796336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:08.317097 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:08.317058 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-q45js" event={"ID":"ecc0f45e-61aa-4180-961d-dae9f1a0facf","Type":"ContainerStarted","Data":"6d192c30552f469156266831986f61c875181d9b3f3c5c4fcb10f3226a54bef8"} Jun 03 19:41:08.317325 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:08.317307 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:41:08.335141 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:08.335097 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-q45js" podStartSLOduration=1.446631593 podStartE2EDuration="4.335079797s" totalImagesPullingTime="2.888448204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:08.333785992 +0000 UTC m=+711.727310911" watchObservedRunningTime="2026-06-03 19:41:08.335079797 +0000 UTC m=+711.728604706" Jun 03 19:41:11.436071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:11.436027 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7r2q8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 03 19:41:11.436435 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:11.436099 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" podUID="636253d1-ba5b-44ae-b302-bbf69ec50227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 03 19:41:12.338133 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.338056 2558 generic.go:356] "Generic (PLEG): container finished" podID="636253d1-ba5b-44ae-b302-bbf69ec50227" containerID="4928096bfaf4680654ceac3614ccb7e828600c213e2436dd506416f848b140d5" exitCode=0 Jun 03 19:41:12.338304 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.338135 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" event={"ID":"636253d1-ba5b-44ae-b302-bbf69ec50227","Type":"ContainerDied","Data":"4928096bfaf4680654ceac3614ccb7e828600c213e2436dd506416f848b140d5"} Jun 03 19:41:12.338527 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.338513 2558 scope.go:117] "RemoveContainer" containerID="4928096bfaf4680654ceac3614ccb7e828600c213e2436dd506416f848b140d5" Jun 03 19:41:12.339541 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.339498 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:41:12.339600 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.339588 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:41:12.339636 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:12.339622 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 19:41:13.322292 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:13.322262 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5b445447cd-q65s4" Jun 03 19:41:13.344864 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:13.344830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" event={"ID":"636253d1-ba5b-44ae-b302-bbf69ec50227","Type":"ContainerStarted","Data":"17a4ba1f5aa6b78a4fa777f6aa60652b780013852ac7161ea223ee4ccfc52d7d"} Jun 03 19:41:14.281339 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:14.281299 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:41:14.281823 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:14.281792 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7r2q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 03 19:41:14.281959 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:14.281887 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" podUID="636253d1-ba5b-44ae-b302-bbf69ec50227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 03 19:41:15.281434 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:15.281397 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7r2q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 03 19:41:15.282022 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:15.281989 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" podUID="636253d1-ba5b-44ae-b302-bbf69ec50227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 03 19:41:16.281184 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:16.281149 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7r2q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jun 03 19:41:16.281451 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:16.281421 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" podUID="636253d1-ba5b-44ae-b302-bbf69ec50227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jun 03 19:41:17.284698 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:17.284671 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:41:17.285164 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:17.284970 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:41:17.285605 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:17.285583 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7r2q8" Jun 03 19:41:19.324604 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:41:19.324572 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-q45js" Jun 03 19:42:04.905202 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:04.905165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:05.000663 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:05.000627 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:29.147994 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.147962 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87"] Jun 03 19:42:29.151450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.151429 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.154917 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.154891 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:42:29.155045 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.154917 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 19:42:29.155045 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.154947 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:42:29.155045 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.154891 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d5d5j\"" Jun 03 19:42:29.164744 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.164721 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87"] Jun 03 19:42:29.183056 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.183032 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:29.189174 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0f40b0-f117-4b51-8093-04b8cd2379cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.189274 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.189274 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.189348 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslhc\" (UniqueName: \"kubernetes.io/projected/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kube-api-access-tslhc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.189348 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.189414 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.189390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290170 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290170 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslhc\" (UniqueName: \"kubernetes.io/projected/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kube-api-access-tslhc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290409 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290409 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290409 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290307 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0f40b0-f117-4b51-8093-04b8cd2379cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290409 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290617 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290551 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290617 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.290733 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.290668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.292695 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.292672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0f40b0-f117-4b51-8093-04b8cd2379cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.292911 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.292894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0f40b0-f117-4b51-8093-04b8cd2379cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.298255 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.298227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslhc\" (UniqueName: \"kubernetes.io/projected/8e0f40b0-f117-4b51-8093-04b8cd2379cc-kube-api-access-tslhc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87\" (UID: \"8e0f40b0-f117-4b51-8093-04b8cd2379cc\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.463562 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.463462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:29.600724 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.600697 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87"] Jun 03 19:42:29.602531 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:42:29.602482 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0f40b0_f117_4b51_8093_04b8cd2379cc.slice/crio-46651a8623579c244eb398efa384219e0cafe2593cc166ec30f050403d44b901 WatchSource:0}: Error finding container 46651a8623579c244eb398efa384219e0cafe2593cc166ec30f050403d44b901: Status 404 returned error can't find the container with id 46651a8623579c244eb398efa384219e0cafe2593cc166ec30f050403d44b901 Jun 03 19:42:29.718275 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:29.718191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" event={"ID":"8e0f40b0-f117-4b51-8093-04b8cd2379cc","Type":"ContainerStarted","Data":"46651a8623579c244eb398efa384219e0cafe2593cc166ec30f050403d44b901"} Jun 03 19:42:33.743331 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:33.743234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" event={"ID":"8e0f40b0-f117-4b51-8093-04b8cd2379cc","Type":"ContainerStarted","Data":"c8619d6b6dcc9977e5bff26e62b34dd1ebcfd0ada451f1223a2e567ffd8c2699"} Jun 03 19:42:34.531546 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.531510 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh"] Jun 03 19:42:34.537056 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.537034 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.539348 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.539327 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 19:42:34.548296 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.548261 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh"] Jun 03 19:42:34.568294 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.568214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:34.639886 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.639827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.640063 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.639974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.640141 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.640103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2k7\" (UniqueName: \"kubernetes.io/projected/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kube-api-access-xf2k7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.640217 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.640189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.640285 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.640235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.640331 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.640284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741310 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741482 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2k7\" (UniqueName: \"kubernetes.io/projected/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kube-api-access-xf2k7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741650 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741957 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.741957 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.741910 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.742498 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.742472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.744114 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.744051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.745153 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.745135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.750546 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.750514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2k7\" (UniqueName: \"kubernetes.io/projected/55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8-kube-api-access-xf2k7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-949sh\" (UID: \"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.849858 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.849821 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:34.987543 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:34.987514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh"] Jun 03 19:42:34.988980 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:42:34.988956 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c9d08c_a4a2_43b5_a5f3_3b496e2a1ea8.slice/crio-d78eab250c05072a9dd4a151f6a5d8122fe285ddead3f7d8bc9bb7db38c9c748 WatchSource:0}: Error finding container d78eab250c05072a9dd4a151f6a5d8122fe285ddead3f7d8bc9bb7db38c9c748: Status 404 returned error can't find the container with id d78eab250c05072a9dd4a151f6a5d8122fe285ddead3f7d8bc9bb7db38c9c748 Jun 03 19:42:35.756525 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:35.756495 2558 generic.go:356] "Generic (PLEG): container finished" podID="8e0f40b0-f117-4b51-8093-04b8cd2379cc" containerID="c8619d6b6dcc9977e5bff26e62b34dd1ebcfd0ada451f1223a2e567ffd8c2699" exitCode=0 Jun 03 19:42:35.756956 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:35.756564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" event={"ID":"8e0f40b0-f117-4b51-8093-04b8cd2379cc","Type":"ContainerDied","Data":"c8619d6b6dcc9977e5bff26e62b34dd1ebcfd0ada451f1223a2e567ffd8c2699"} Jun 03 19:42:35.758166 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:35.758143 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" event={"ID":"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8","Type":"ContainerStarted","Data":"0a2de542b51d1c4a3a67dc50572ff22352dc4a9b5fd36f0aca0b8da18b705125"} Jun 03 19:42:35.758281 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:35.758186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" event={"ID":"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8","Type":"ContainerStarted","Data":"d78eab250c05072a9dd4a151f6a5d8122fe285ddead3f7d8bc9bb7db38c9c748"} Jun 03 19:42:36.765946 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:36.765909 2558 generic.go:356] "Generic (PLEG): container finished" podID="55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8" containerID="0a2de542b51d1c4a3a67dc50572ff22352dc4a9b5fd36f0aca0b8da18b705125" exitCode=0 Jun 03 19:42:36.766372 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:36.765996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" event={"ID":"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8","Type":"ContainerDied","Data":"0a2de542b51d1c4a3a67dc50572ff22352dc4a9b5fd36f0aca0b8da18b705125"} Jun 03 19:42:37.772781 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:37.772748 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" event={"ID":"8e0f40b0-f117-4b51-8093-04b8cd2379cc","Type":"ContainerStarted","Data":"112f44f1b3ea2aabcae8871458bd9317f974493fe1e3982144644218a6eae7b2"} Jun 03 19:42:37.774708 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:37.774677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" event={"ID":"55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8","Type":"ContainerStarted","Data":"25106d324392d7ba650323a4402a5adb31b720f03e85148e3ed09c44f73b4b39"} Jun 03 19:42:37.793833 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:37.793785 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" podStartSLOduration=2.329725555 podStartE2EDuration="8.793766903s" totalImagesPullingTime="5.161131136s" totalInitContainerRuntime="1.302910212s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:37.79283181 +0000 UTC m=+801.186356724" watchObservedRunningTime="2026-06-03 19:42:37.793766903 +0000 UTC m=+801.187291811" Jun 03 19:42:37.811981 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:37.811944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" podStartSLOduration=1.885667675 podStartE2EDuration="3.811930326s" totalImagesPullingTime="352.735768ms" totalInitContainerRuntime="1.573526883s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:37.811021333 +0000 UTC m=+801.204546250" watchObservedRunningTime="2026-06-03 19:42:37.811930326 +0000 UTC m=+801.205455243" Jun 03 19:42:39.464509 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:39.464475 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:39.464928 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:39.464537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:39.481218 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:39.481191 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:39.798174 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:39.798136 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87" Jun 03 19:42:41.457930 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:41.457894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:44.850438 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:44.850403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:44.850809 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:44.850470 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:44.863019 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:44.862995 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:45.827530 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:45.827503 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-949sh" Jun 03 19:42:50.078204 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.078168 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd"] Jun 03 19:42:50.086615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.086588 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.089169 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.089143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 19:42:50.094882 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.094835 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd"] Jun 03 19:42:50.134631 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.134585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:50.184553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.184553 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.184753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.184753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.184753 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdde5d93-be44-4366-8758-b35f975971f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.184877 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.184777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fht7m\" (UniqueName: \"kubernetes.io/projected/bdde5d93-be44-4366-8758-b35f975971f9-kube-api-access-fht7m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.285927 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.285882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.285945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.285963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdde5d93-be44-4366-8758-b35f975971f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fht7m\" (UniqueName: \"kubernetes.io/projected/bdde5d93-be44-4366-8758-b35f975971f9-kube-api-access-fht7m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286185 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286444 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286444 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.286554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.286457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.288455 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.288433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdde5d93-be44-4366-8758-b35f975971f9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.288654 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.288637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdde5d93-be44-4366-8758-b35f975971f9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.293941 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.293921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fht7m\" (UniqueName: \"kubernetes.io/projected/bdde5d93-be44-4366-8758-b35f975971f9-kube-api-access-fht7m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd\" (UID: \"bdde5d93-be44-4366-8758-b35f975971f9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.399515 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.399432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:42:50.549932 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.549903 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd"] Jun 03 19:42:50.552044 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:42:50.552016 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdde5d93_be44_4366_8758_b35f975971f9.slice/crio-328ca76cba0ef88a3f857ebaf1051e4f94fe20d0659282160ee4aef92c41177a WatchSource:0}: Error finding container 328ca76cba0ef88a3f857ebaf1051e4f94fe20d0659282160ee4aef92c41177a: Status 404 returned error can't find the container with id 328ca76cba0ef88a3f857ebaf1051e4f94fe20d0659282160ee4aef92c41177a Jun 03 19:42:50.843069 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.843031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" event={"ID":"bdde5d93-be44-4366-8758-b35f975971f9","Type":"ContainerStarted","Data":"0bee40122ab472ba98f91c48033e8449c748e629fe3368a95ab22bc8443db9d0"} Jun 03 19:42:50.843256 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:50.843090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" event={"ID":"bdde5d93-be44-4366-8758-b35f975971f9","Type":"ContainerStarted","Data":"328ca76cba0ef88a3f857ebaf1051e4f94fe20d0659282160ee4aef92c41177a"} Jun 03 19:42:53.859326 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:53.859291 2558 generic.go:356] "Generic (PLEG): container finished" podID="bdde5d93-be44-4366-8758-b35f975971f9" containerID="0bee40122ab472ba98f91c48033e8449c748e629fe3368a95ab22bc8443db9d0" exitCode=0 Jun 03 19:42:53.859751 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:53.859366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" event={"ID":"bdde5d93-be44-4366-8758-b35f975971f9","Type":"ContainerDied","Data":"0bee40122ab472ba98f91c48033e8449c748e629fe3368a95ab22bc8443db9d0"} Jun 03 19:42:54.866923 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:54.866890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" event={"ID":"bdde5d93-be44-4366-8758-b35f975971f9","Type":"ContainerStarted","Data":"169fe3fe2db54caa29160434e0fe0a49c8370db1db54a13811214c189b1f1735"} Jun 03 19:42:54.890629 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:42:54.890576 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" podStartSLOduration=2.197175749 podStartE2EDuration="4.890559628s" totalImagesPullingTime="258.846571ms" totalInitContainerRuntime="2.434537308s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:54.88831884 +0000 UTC m=+818.281843763" watchObservedRunningTime="2026-06-03 19:42:54.890559628 +0000 UTC m=+818.284084536" Jun 03 19:43:00.400421 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:00.400387 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:43:00.400921 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:00.400460 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:43:00.413350 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:00.413329 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:43:00.906634 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:00.906608 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd" Jun 03 19:43:09.229103 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.229073 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8"] Jun 03 19:43:09.234034 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.234010 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.236452 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.236425 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 19:43:09.245524 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.245501 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8"] Jun 03 19:43:09.265424 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.265392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:09.349823 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.349794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.350013 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.349836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.350013 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.349994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cln6\" (UniqueName: \"kubernetes.io/projected/e1155f94-6042-489c-880f-90dc4b79592d-kube-api-access-4cln6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.350090 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.350047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1155f94-6042-489c-880f-90dc4b79592d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.350129 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.350086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.350164 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.350149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.450789 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.450757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.450789 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.450802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451027 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.450880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cln6\" (UniqueName: \"kubernetes.io/projected/e1155f94-6042-489c-880f-90dc4b79592d-kube-api-access-4cln6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451027 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.450911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1155f94-6042-489c-880f-90dc4b79592d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451027 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.450944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451027 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.451003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451292 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.451268 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451368 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.451290 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.451368 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.451314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.453316 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.453294 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1155f94-6042-489c-880f-90dc4b79592d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.453474 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.453456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1155f94-6042-489c-880f-90dc4b79592d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.459340 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.459317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cln6\" (UniqueName: \"kubernetes.io/projected/e1155f94-6042-489c-880f-90dc4b79592d-kube-api-access-4cln6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8\" (UID: \"e1155f94-6042-489c-880f-90dc4b79592d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.547173 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.547128 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:09.686706 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.686668 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8"] Jun 03 19:43:09.686967 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:43:09.686945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1155f94_6042_489c_880f_90dc4b79592d.slice/crio-0c07c6605baed6512fbeda1a72b82731671d51eb3a63e1e66756769b0df18076 WatchSource:0}: Error finding container 0c07c6605baed6512fbeda1a72b82731671d51eb3a63e1e66756769b0df18076: Status 404 returned error can't find the container with id 0c07c6605baed6512fbeda1a72b82731671d51eb3a63e1e66756769b0df18076 Jun 03 19:43:09.941817 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.941721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" event={"ID":"e1155f94-6042-489c-880f-90dc4b79592d","Type":"ContainerStarted","Data":"b214927f35599e5380d85042da0b6daacee06603dc5dae1209146e0da2882d74"} Jun 03 19:43:09.941817 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:09.941791 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" event={"ID":"e1155f94-6042-489c-880f-90dc4b79592d","Type":"ContainerStarted","Data":"0c07c6605baed6512fbeda1a72b82731671d51eb3a63e1e66756769b0df18076"} Jun 03 19:43:11.955448 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:11.955415 2558 generic.go:356] "Generic (PLEG): container finished" podID="e1155f94-6042-489c-880f-90dc4b79592d" containerID="b214927f35599e5380d85042da0b6daacee06603dc5dae1209146e0da2882d74" exitCode=0 Jun 03 19:43:11.955815 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:11.955487 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" event={"ID":"e1155f94-6042-489c-880f-90dc4b79592d","Type":"ContainerDied","Data":"b214927f35599e5380d85042da0b6daacee06603dc5dae1209146e0da2882d74"} Jun 03 19:43:12.962234 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:12.962201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" event={"ID":"e1155f94-6042-489c-880f-90dc4b79592d","Type":"ContainerStarted","Data":"c17bdda7949a3f033966bd37af96fe6bbe7c541121876156234402bcf75c6471"} Jun 03 19:43:12.981965 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:12.981918 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" podStartSLOduration=2.509386609 podStartE2EDuration="3.981902901s" totalImagesPullingTime="248.864888ms" totalInitContainerRuntime="1.223651404s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:12.980662576 +0000 UTC m=+836.374187507" watchObservedRunningTime="2026-06-03 19:43:12.981902901 +0000 UTC m=+836.375427809" Jun 03 19:43:14.641726 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.641689 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7"] Jun 03 19:43:14.645663 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.645642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.648050 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.648033 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 19:43:14.657696 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.657670 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7"] Jun 03 19:43:14.696453 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.696615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4srm\" (UniqueName: \"kubernetes.io/projected/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kube-api-access-x4srm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.696615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.696615 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.696775 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696688 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ce351a-959b-4f7f-8cfe-b94be1406fcb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.696775 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.696728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.724544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.724513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:14.797324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797324 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4srm\" (UniqueName: \"kubernetes.io/projected/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kube-api-access-x4srm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797406 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ce351a-959b-4f7f-8cfe-b94be1406fcb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797542 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797837 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797960 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797882 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.797960 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.797938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.799583 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.799557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ce351a-959b-4f7f-8cfe-b94be1406fcb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.799972 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.799951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ce351a-959b-4f7f-8cfe-b94be1406fcb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.806396 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.806374 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4srm\" (UniqueName: \"kubernetes.io/projected/49ce351a-959b-4f7f-8cfe-b94be1406fcb-kube-api-access-x4srm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-td4v7\" (UID: \"49ce351a-959b-4f7f-8cfe-b94be1406fcb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:14.955842 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:14.955762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:15.113272 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:15.113249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7"] Jun 03 19:43:15.115058 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:43:15.115026 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ce351a_959b_4f7f_8cfe_b94be1406fcb.slice/crio-62af4114f18e35e9646b1002737c737264ae0381a2640a76bd737e4cd6031d8d WatchSource:0}: Error finding container 62af4114f18e35e9646b1002737c737264ae0381a2640a76bd737e4cd6031d8d: Status 404 returned error can't find the container with id 62af4114f18e35e9646b1002737c737264ae0381a2640a76bd737e4cd6031d8d Jun 03 19:43:15.986755 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:15.986723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" event={"ID":"49ce351a-959b-4f7f-8cfe-b94be1406fcb","Type":"ContainerStarted","Data":"80f6c0270d08b1ff775f1d961f6d1131e2c96d547e1a6cf899b2a202f89e0fb3"} Jun 03 19:43:15.987238 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:15.986782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" event={"ID":"49ce351a-959b-4f7f-8cfe-b94be1406fcb","Type":"ContainerStarted","Data":"62af4114f18e35e9646b1002737c737264ae0381a2640a76bd737e4cd6031d8d"} Jun 03 19:43:16.993420 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:16.993381 2558 generic.go:356] "Generic (PLEG): container finished" podID="49ce351a-959b-4f7f-8cfe-b94be1406fcb" containerID="80f6c0270d08b1ff775f1d961f6d1131e2c96d547e1a6cf899b2a202f89e0fb3" exitCode=0 Jun 03 19:43:16.993819 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:16.993463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" event={"ID":"49ce351a-959b-4f7f-8cfe-b94be1406fcb","Type":"ContainerDied","Data":"80f6c0270d08b1ff775f1d961f6d1131e2c96d547e1a6cf899b2a202f89e0fb3"} Jun 03 19:43:18.000660 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:18.000626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" event={"ID":"49ce351a-959b-4f7f-8cfe-b94be1406fcb","Type":"ContainerStarted","Data":"473366fef9124da0fab5091773897b4705fd68b6d8c64645ad350de79b4d9cc6"} Jun 03 19:43:18.021814 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:18.021768 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" podStartSLOduration=2.512448925 podStartE2EDuration="4.021749246s" totalImagesPullingTime="303.000739ms" totalInitContainerRuntime="1.206299582s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:18.02068227 +0000 UTC m=+841.414207182" watchObservedRunningTime="2026-06-03 19:43:18.021749246 +0000 UTC m=+841.415274152" Jun 03 19:43:19.547622 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:19.547581 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:19.548159 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:19.547677 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:19.560554 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:19.560527 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:20.022958 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:20.022934 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8" Jun 03 19:43:24.956481 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:24.956449 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:24.956928 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:24.956512 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:24.975454 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:24.969968 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:25.050332 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:25.050303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-td4v7" Jun 03 19:43:26.874790 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:43:26.874743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:26.699956 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:44:26.699896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:26.801875 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:44:26.801812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:27.817414 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:44:27.817378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:27.919878 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:44:27.919810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:53.509954 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.509915 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:53.597556 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.597521 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:45:53.597738 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.597721 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f88c8c74d-5fl66" podUID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" containerName="manager" containerID="cri-o://7885f299281c9ebf1254ed2d68353854abb65939294f507b57b1e1d0d3e0fb8a" gracePeriod=30 Jun 03 19:45:53.826618 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.826587 2558 generic.go:356] "Generic (PLEG): container finished" podID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" containerID="7885f299281c9ebf1254ed2d68353854abb65939294f507b57b1e1d0d3e0fb8a" exitCode=0 Jun 03 19:45:53.826795 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.826661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-5fl66" event={"ID":"d401ba14-dc9c-4bb1-b9e1-901a184c8a62","Type":"ContainerDied","Data":"7885f299281c9ebf1254ed2d68353854abb65939294f507b57b1e1d0d3e0fb8a"} Jun 03 19:45:53.851888 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.851866 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:45:53.961446 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.961413 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert\") pod \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " Jun 03 19:45:53.961630 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.961481 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkst5\" (UniqueName: \"kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5\") pod \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\" (UID: \"d401ba14-dc9c-4bb1-b9e1-901a184c8a62\") " Jun 03 19:45:53.963448 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.963419 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5" (OuterVolumeSpecName: "kube-api-access-pkst5") pod "d401ba14-dc9c-4bb1-b9e1-901a184c8a62" (UID: "d401ba14-dc9c-4bb1-b9e1-901a184c8a62"). InnerVolumeSpecName "kube-api-access-pkst5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:45:53.963580 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:53.963558 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d401ba14-dc9c-4bb1-b9e1-901a184c8a62" (UID: "d401ba14-dc9c-4bb1-b9e1-901a184c8a62"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:45:54.062507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.062419 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkst5\" (UniqueName: \"kubernetes.io/projected/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-kube-api-access-pkst5\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:45:54.062507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.062459 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d401ba14-dc9c-4bb1-b9e1-901a184c8a62-webhook-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jun 03 19:45:54.832997 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.832966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-5fl66" event={"ID":"d401ba14-dc9c-4bb1-b9e1-901a184c8a62","Type":"ContainerDied","Data":"1d9953730a9970d35f67a08153cd0b9b5a23472e73b93490ced60a38997c0665"} Jun 03 19:45:54.832997 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.832979 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-5fl66" Jun 03 19:45:54.833438 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.833029 2558 scope.go:117] "RemoveContainer" containerID="7885f299281c9ebf1254ed2d68353854abb65939294f507b57b1e1d0d3e0fb8a" Jun 03 19:45:54.859258 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.859233 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:45:54.865711 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:54.865688 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-5fl66"] Jun 03 19:45:55.117034 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.116957 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" path="/var/lib/kubelet/pods/d401ba14-dc9c-4bb1-b9e1-901a184c8a62/volumes" Jun 03 19:45:55.502625 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.502593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:55.614205 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.614164 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f88c8c74d-c62dz"] Jun 03 19:45:55.614778 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.614752 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" containerName="manager" Jun 03 19:45:55.614964 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.614919 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" containerName="manager" Jun 03 19:45:55.615071 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.615056 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d401ba14-dc9c-4bb1-b9e1-901a184c8a62" containerName="manager" Jun 03 19:45:55.619539 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.619518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.622146 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.622123 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:45:55.622971 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.622953 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 03 19:45:55.623059 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.623014 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qgjb\"" Jun 03 19:45:55.627768 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.627742 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-c62dz"] Jun 03 19:45:55.778931 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.778814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9s6n\" (UniqueName: \"kubernetes.io/projected/5665f708-8b10-4f9b-9470-e49f2ba0af2e-kube-api-access-z9s6n\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.779086 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.778938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5665f708-8b10-4f9b-9470-e49f2ba0af2e-webhook-cert\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.880166 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.880139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9s6n\" (UniqueName: \"kubernetes.io/projected/5665f708-8b10-4f9b-9470-e49f2ba0af2e-kube-api-access-z9s6n\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.880563 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.880182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5665f708-8b10-4f9b-9470-e49f2ba0af2e-webhook-cert\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.882544 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.882523 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5665f708-8b10-4f9b-9470-e49f2ba0af2e-webhook-cert\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.887797 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.887776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9s6n\" (UniqueName: \"kubernetes.io/projected/5665f708-8b10-4f9b-9470-e49f2ba0af2e-kube-api-access-z9s6n\") pod \"maas-controller-f88c8c74d-c62dz\" (UID: \"5665f708-8b10-4f9b-9470-e49f2ba0af2e\") " pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:55.931276 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:55.931255 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:56.062969 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.062939 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f88c8c74d-c62dz"] Jun 03 19:45:56.064440 ip-10-0-136-174 kubenswrapper[2558]: W0603 19:45:56.064412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5665f708_8b10_4f9b_9470_e49f2ba0af2e.slice/crio-a59696e84b995fae6c7ce779fac2fd7b300b8dc5e560ec0f90a7ca32d15b3df2 WatchSource:0}: Error finding container a59696e84b995fae6c7ce779fac2fd7b300b8dc5e560ec0f90a7ca32d15b3df2: Status 404 returned error can't find the container with id a59696e84b995fae6c7ce779fac2fd7b300b8dc5e560ec0f90a7ca32d15b3df2 Jun 03 19:45:56.065796 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.065779 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:45:56.845469 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.845380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-c62dz" event={"ID":"5665f708-8b10-4f9b-9470-e49f2ba0af2e","Type":"ContainerStarted","Data":"a0cac7774c925ef24000ca2fe9586ba9c0f1ed8e6623691d4d253dbb6a5ab10b"} Jun 03 19:45:56.845469 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.845435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f88c8c74d-c62dz" event={"ID":"5665f708-8b10-4f9b-9470-e49f2ba0af2e","Type":"ContainerStarted","Data":"a59696e84b995fae6c7ce779fac2fd7b300b8dc5e560ec0f90a7ca32d15b3df2"} Jun 03 19:45:56.845651 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.845520 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:45:56.864726 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:45:56.864680 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f88c8c74d-c62dz" podStartSLOduration=1.39519956 podStartE2EDuration="1.864665203s" totalImagesPullingTime="469.465643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:45:56.862741811 +0000 UTC m=+1000.256266731" watchObservedRunningTime="2026-06-03 19:45:56.864665203 +0000 UTC m=+1000.258190121" Jun 03 19:46:07.230556 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:07.230513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:07.283302 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:07.283260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:07.857780 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:07.857751 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f88c8c74d-c62dz" Jun 03 19:46:37.555277 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:37.555233 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:37.761086 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:37.761054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:46.055177 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:46.055118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:51.960357 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:51.960318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:52.064797 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:46:52.064763 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:24.118732 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:24.118641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:24.222238 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:24.222200 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:29.852715 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:29.852677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:29.913764 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:29.913728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:48.067562 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:48.067527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:53.919545 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:53.919503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:54.029204 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:54.029136 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:54.120944 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:54.120904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:54.283365 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:54.283329 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:54.384252 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:47:54.384188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:10.758526 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:10.758483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:10.869450 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:10.869411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:10.995418 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:10.995382 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:17.141626 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:17.141586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:17.215203 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:17.215163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:25.294777 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:25.294738 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:25.389314 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:25.389271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:25.486643 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:25.486607 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:25.586459 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:25.586370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:42.019208 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:42.019111 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:42.129311 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:42.129271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:42.246507 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:42.246473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:48.063551 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:48.063519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:48.167624 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:48:48.167584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:10.617930 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:10.617892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:10.718128 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:10.718083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:10.833398 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:10.833360 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:16.560317 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:16.560280 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:16.625348 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:16.625313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:16.709754 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:16.709721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:16.809922 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:16.809890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:16.912282 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:16.912181 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:22.814985 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:22.814950 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:49:22.896709 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:49:22.896670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:21.364354 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:52:21.364302 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:28.518350 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:52:28.518311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:28.574125 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:52:28.574085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:59:04.608842 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:59:04.608799 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 19:59:05.691673 ip-10-0-136-174 kubenswrapper[2558]: I0603 19:59:05.691640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:30.065337 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:01:30.065259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:05:34.071546 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:05:34.071450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:05:35.187652 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:05:35.187610 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:06:43.564663 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:06:43.564554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:06:53.196036 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:06:53.195987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:07:17.466359 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:17.466315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:07:30.539268 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:30.539212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:07:42.730799 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:42.730768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f58cfb955-rqwhn_344d0e3f-0e1d-4956-92ad-a222af47e0d9/nginx/0.log" Jun 03 20:07:42.838792 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:42.838759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-s2dx2_5405fe7a-513c-4ba6-b2b9-40cf035cbfa1/manager/0.log" Jun 03 20:07:42.965981 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:42.965951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lvzgf_7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e/manager/0.log" Jun 03 20:07:43.090161 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.090121 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b445447cd-q65s4_88f98f0d-9926-433e-adab-c592a4eb03d7/maas-api/0.log" Jun 03 20:07:43.445153 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.445049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f88c8c74d-c62dz_5665f708-8b10-4f9b-9470-e49f2ba0af2e/manager/0.log" Jun 03 20:07:43.554154 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.554125 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-62lh6_94c6ca2a-c670-49e9-9294-865b12612904/server/0.log" Jun 03 20:07:43.677352 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.677315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9rlfg_1fb40967-16f7-4e1c-a6e0-8d9d66393c22/manager/0.log" Jun 03 20:07:43.904283 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.904246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-fdnq2_05d2f422-e6e0-49ec-a142-b3e63b8f9b3a/copy-manifests/0.log" Jun 03 20:07:43.913249 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:43.913218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-fdnq2_05d2f422-e6e0-49ec-a142-b3e63b8f9b3a/manager/0.log" Jun 03 20:07:44.154639 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:44.154547 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-qd897_3d7b73ea-0d98-4250-87a4-5d277076f155/postgres/0.log" Jun 03 20:07:45.701042 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:45.700986 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qqh5c_e526bd53-a373-4308-b94c-47779caee048/manager/0.log" Jun 03 20:07:46.771032 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:46.770978 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mz8hd_ea6ca8ef-b85a-416b-843d-fad3d3b51b96/discovery/0.log" Jun 03 20:07:46.987905 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:46.987833 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b7b7cf99-hq8hj_59fc926e-3d1b-4d4c-9874-0480f35faf70/kube-auth-proxy/0.log" Jun 03 20:07:47.112072 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.111967 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/1.log" Jun 03 20:07:47.238826 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.238789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q45js_ecc0f45e-61aa-4180-961d-dae9f1a0facf/payload-processing/0.log" Jun 03 20:07:47.357601 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.357568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 20:07:47.700323 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.700291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87_8e0f40b0-f117-4b51-8093-04b8cd2379cc/storage-initializer/0.log" Jun 03 20:07:47.709214 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.709189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qwb87_8e0f40b0-f117-4b51-8093-04b8cd2379cc/main/0.log" Jun 03 20:07:47.822238 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.822208 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-949sh_55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8/storage-initializer/0.log" Jun 03 20:07:47.830958 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.830926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-949sh_55c9d08c-a4a2-43b5-a5f3-3b496e2a1ea8/main/0.log" Jun 03 20:07:47.943719 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.943678 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd_bdde5d93-be44-4366-8758-b35f975971f9/storage-initializer/0.log" Jun 03 20:07:47.952388 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:47.952297 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-j8znd_bdde5d93-be44-4366-8758-b35f975971f9/main/0.log" Jun 03 20:07:48.069090 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:48.069042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8_e1155f94-6042-489c-880f-90dc4b79592d/storage-initializer/0.log" Jun 03 20:07:48.077374 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:48.077344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ck5jf8_e1155f94-6042-489c-880f-90dc4b79592d/main/0.log" Jun 03 20:07:48.187564 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:48.187529 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-td4v7_49ce351a-959b-4f7f-8cfe-b94be1406fcb/storage-initializer/0.log" Jun 03 20:07:48.195216 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:48.195182 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-td4v7_49ce351a-959b-4f7f-8cfe-b94be1406fcb/main/0.log" Jun 03 20:07:52.902902 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:52.902840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:07:52.971704 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:52.971659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" limit=1024 Jun 03 20:07:56.151618 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:56.151566 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zm2zr_acd494d0-55f8-4f38-8c26-1ce04f072b0a/global-pull-secret-syncer/0.log" Jun 03 20:07:56.201436 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:56.201395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jvpc6_16354d68-0ac3-4a7a-b8e0-8f88830365c6/konnectivity-agent/0.log" Jun 03 20:07:56.291876 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:56.291834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-174.ec2.internal_03c065fca101d5f39c7adc677b1cb157/haproxy/0.log" Jun 03 20:07:58.537986 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:07:58.537951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-c24hp_556d13d0-e078-4ca4-92ac-13ae9abc9f2f/sail-operator/0.log" Jun 03 20:08:01.491418 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:01.491384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qqh5c_e526bd53-a373-4308-b94c-47779caee048/manager/0.log" Jun 03 20:08:03.874707 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:03.874674 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fw2kx_25d604d2-4f9e-4f9f-a331-4ff799d678ab/node-exporter/0.log" Jun 03 20:08:03.897276 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:03.897243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fw2kx_25d604d2-4f9e-4f9f-a331-4ff799d678ab/kube-rbac-proxy/0.log" Jun 03 20:08:03.917597 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:03.917571 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fw2kx_25d604d2-4f9e-4f9f-a331-4ff799d678ab/init-textfile/0.log" Jun 03 20:08:08.048411 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.048314 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq"] Jun 03 20:08:08.052086 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.052064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.054980 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.054956 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2jt7\"/\"openshift-service-ca.crt\"" Jun 03 20:08:08.055883 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.055829 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2jt7\"/\"default-dockercfg-r6dvp\"" Jun 03 20:08:08.056014 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.055907 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2jt7\"/\"kube-root-ca.crt\"" Jun 03 20:08:08.064180 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.064154 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq"] Jun 03 20:08:08.137256 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.137213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-podres\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.137442 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.137269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlvw9\" (UniqueName: \"kubernetes.io/projected/608c1373-4cd5-489a-a994-20cf76ebee8a-kube-api-access-nlvw9\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.137442 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.137356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-lib-modules\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.137442 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.137398 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-proc\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.137442 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.137430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-sys\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.238716 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlvw9\" (UniqueName: \"kubernetes.io/projected/608c1373-4cd5-489a-a994-20cf76ebee8a-kube-api-access-nlvw9\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.238921 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-lib-modules\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.238921 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-proc\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.238921 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-sys\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.239042 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-podres\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.239042 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-lib-modules\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.239042 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.238976 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-proc\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.239042 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.239002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-sys\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.239169 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.239095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/608c1373-4cd5-489a-a994-20cf76ebee8a-podres\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.247284 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.247256 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlvw9\" (UniqueName: \"kubernetes.io/projected/608c1373-4cd5-489a-a994-20cf76ebee8a-kube-api-access-nlvw9\") pod \"perf-node-gather-daemonset-n2xnq\" (UID: \"608c1373-4cd5-489a-a994-20cf76ebee8a\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.364700 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.364608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:08.511838 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:08.511791 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq"] Jun 03 20:08:08.516958 ip-10-0-136-174 kubenswrapper[2558]: W0603 20:08:08.516908 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod608c1373_4cd5_489a_a994_20cf76ebee8a.slice/crio-1104a0ac999dd7d8f1b913250d5146fb5e6baf0e38787c69354727943babd359 WatchSource:0}: Error finding container 1104a0ac999dd7d8f1b913250d5146fb5e6baf0e38787c69354727943babd359: Status 404 returned error can't find the container with id 1104a0ac999dd7d8f1b913250d5146fb5e6baf0e38787c69354727943babd359 Jun 03 20:08:09.065897 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.065859 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" event={"ID":"608c1373-4cd5-489a-a994-20cf76ebee8a","Type":"ContainerStarted","Data":"191911a590bcbbe45630794df4e2d036d8edbb0b1f657761207511b30e219d1c"} Jun 03 20:08:09.066305 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.065912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" event={"ID":"608c1373-4cd5-489a-a994-20cf76ebee8a","Type":"ContainerStarted","Data":"1104a0ac999dd7d8f1b913250d5146fb5e6baf0e38787c69354727943babd359"} Jun 03 20:08:09.066305 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.066002 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:09.083270 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.083215 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" podStartSLOduration=1.083198655 podStartE2EDuration="1.083198655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:08:09.080962804 +0000 UTC m=+2332.474487711" watchObservedRunningTime="2026-06-03 20:08:09.083198655 +0000 UTC m=+2332.476723562" Jun 03 20:08:09.265675 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.265646 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8r76_adc0d0c5-cdfe-4312-8ca0-101a64635ca7/dns/0.log" Jun 03 20:08:09.302154 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.302124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8r76_adc0d0c5-cdfe-4312-8ca0-101a64635ca7/kube-rbac-proxy/0.log" Jun 03 20:08:09.440587 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:09.440484 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bptc6_b21ddd88-5737-45b4-a4e6-caff70db04ee/dns-node-resolver/0.log" Jun 03 20:08:10.000048 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:10.000009 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zshw_9c40e8a6-2d9c-49bc-ae5a-a00d411c44c4/node-ca/0.log" Jun 03 20:08:11.195384 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.195347 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mz8hd_ea6ca8ef-b85a-416b-843d-fad3d3b51b96/discovery/0.log" Jun 03 20:08:11.241303 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.241269 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b7b7cf99-hq8hj_59fc926e-3d1b-4d4c-9874-0480f35faf70/kube-auth-proxy/0.log" Jun 03 20:08:11.275078 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.275048 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/0.log" Jun 03 20:08:11.341496 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.341465 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/1.log" Jun 03 20:08:11.454304 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.454211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q45js_ecc0f45e-61aa-4180-961d-dae9f1a0facf/payload-processing/0.log" Jun 03 20:08:11.479371 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:11.479324 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 20:08:12.065199 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:12.065158 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-97lw7_eb9298ab-5021-46a3-85a4-bfb516910a53/serve-healthcheck-canary/0.log" Jun 03 20:08:12.781419 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:12.781384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcdg8_18118ef0-6c8c-4c45-a0ae-16ad6bceea89/kube-rbac-proxy/0.log" Jun 03 20:08:12.806557 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:12.806531 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcdg8_18118ef0-6c8c-4c45-a0ae-16ad6bceea89/exporter/0.log" Jun 03 20:08:12.831880 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:12.831832 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcdg8_18118ef0-6c8c-4c45-a0ae-16ad6bceea89/extractor/0.log" Jun 03 20:08:15.039043 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.039013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f58cfb955-rqwhn_344d0e3f-0e1d-4956-92ad-a222af47e0d9/nginx/0.log" Jun 03 20:08:15.070585 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.070551 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-s2dx2_5405fe7a-513c-4ba6-b2b9-40cf035cbfa1/manager/0.log" Jun 03 20:08:15.081566 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.081538 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-n2xnq" Jun 03 20:08:15.206122 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.206086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lvzgf_7ae3ac5f-c3f1-48fa-9556-dcd82bb8238e/manager/0.log" Jun 03 20:08:15.254592 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.254555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b445447cd-q65s4_88f98f0d-9926-433e-adab-c592a4eb03d7/maas-api/0.log" Jun 03 20:08:15.414259 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.414148 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f88c8c74d-c62dz_5665f708-8b10-4f9b-9470-e49f2ba0af2e/manager/0.log" Jun 03 20:08:15.435901 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.435872 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-62lh6_94c6ca2a-c670-49e9-9294-865b12612904/server/0.log" Jun 03 20:08:15.508285 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.508254 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9rlfg_1fb40967-16f7-4e1c-a6e0-8d9d66393c22/manager/0.log" Jun 03 20:08:15.598403 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.598369 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-fdnq2_05d2f422-e6e0-49ec-a142-b3e63b8f9b3a/manager/0.log" Jun 03 20:08:15.619287 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.619261 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-fdnq2_05d2f422-e6e0-49ec-a142-b3e63b8f9b3a/copy-manifests/0.log" Jun 03 20:08:15.856953 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:15.856918 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-qd897_3d7b73ea-0d98-4250-87a4-5d277076f155/postgres/0.log" Jun 03 20:08:17.724245 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:17.724211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qgrrv_9d549710-c6bf-4349-8b1e-7759d3678720/openshift-lws-operator/0.log" Jun 03 20:08:20.372868 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.372821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mz8hd_ea6ca8ef-b85a-416b-843d-fad3d3b51b96/discovery/0.log" Jun 03 20:08:20.399221 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.399190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b7b7cf99-hq8hj_59fc926e-3d1b-4d4c-9874-0480f35faf70/kube-auth-proxy/0.log" Jun 03 20:08:20.419309 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.419275 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/0.log" Jun 03 20:08:20.495967 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.495929 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/1.log" Jun 03 20:08:20.592362 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.592327 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q45js_ecc0f45e-61aa-4180-961d-dae9f1a0facf/payload-processing/0.log" Jun 03 20:08:20.606437 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:20.606403 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 20:08:21.877510 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:21.877470 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mz8hd_ea6ca8ef-b85a-416b-843d-fad3d3b51b96/discovery/0.log" Jun 03 20:08:21.906952 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:21.906911 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b7b7cf99-hq8hj_59fc926e-3d1b-4d4c-9874-0480f35faf70/kube-auth-proxy/0.log" Jun 03 20:08:21.926929 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:21.926902 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/0.log" Jun 03 20:08:21.990728 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:21.990694 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/1.log" Jun 03 20:08:22.084175 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:22.084139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q45js_ecc0f45e-61aa-4180-961d-dae9f1a0facf/payload-processing/0.log" Jun 03 20:08:22.101783 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:22.101745 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 20:08:23.085964 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:23.085908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-f86mz_10fc038f-1bf1-4253-9bf8-2a39f54dc64b/migrator/0.log" Jun 03 20:08:23.106683 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:23.106621 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-f86mz_10fc038f-1bf1-4253-9bf8-2a39f54dc64b/graceful-termination/0.log" Jun 03 20:08:23.497619 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:23.497518 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc_33aec51f-a9fd-49b2-b1a1-1ee28a964077/kube-storage-version-migrator-operator/1.log" Jun 03 20:08:23.499323 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:23.499298 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-k2bgc_33aec51f-a9fd-49b2-b1a1-1ee28a964077/kube-storage-version-migrator-operator/0.log" Jun 03 20:08:24.096883 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.096833 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mz8hd_ea6ca8ef-b85a-416b-843d-fad3d3b51b96/discovery/0.log" Jun 03 20:08:24.123294 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.123257 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b7b7cf99-hq8hj_59fc926e-3d1b-4d4c-9874-0480f35faf70/kube-auth-proxy/0.log" Jun 03 20:08:24.147835 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.147803 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/0.log" Jun 03 20:08:24.214228 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.214190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7r2q8_636253d1-ba5b-44ae-b302-bbf69ec50227/istio-proxy/1.log" Jun 03 20:08:24.304551 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.304515 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q45js_ecc0f45e-61aa-4180-961d-dae9f1a0facf/payload-processing/0.log" Jun 03 20:08:24.319227 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.319191 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-88876b98f-lhfhs_fe22cf6d-5f7e-4459-9adb-c8ee293848f4/router/0.log" Jun 03 20:08:24.954480 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.954455 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/kube-multus-additional-cni-plugins/0.log" Jun 03 20:08:24.976318 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.976290 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/egress-router-binary-copy/0.log" Jun 03 20:08:24.996375 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:24.996343 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/cni-plugins/0.log" Jun 03 20:08:25.017203 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.017171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/bond-cni-plugin/0.log" Jun 03 20:08:25.038456 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.038426 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/routeoverride-cni/0.log" Jun 03 20:08:25.060826 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.060790 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/whereabouts-cni-bincopy/0.log" Jun 03 20:08:25.084024 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.083993 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7tkx_36d41982-7cb1-446a-a9ff-2466e9b810cb/whereabouts-cni/0.log" Jun 03 20:08:25.186451 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.186422 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s9lwm_4bf0bd33-761a-42b4-aff1-f11a3728e74c/kube-multus/0.log" Jun 03 20:08:25.303896 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.303834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x2z9d_b3800785-1ff3-45a4-8249-27ed1300a522/network-metrics-daemon/0.log" Jun 03 20:08:25.322738 ip-10-0-136-174 kubenswrapper[2558]: I0603 20:08:25.322708 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x2z9d_b3800785-1ff3-45a4-8249-27ed1300a522/kube-rbac-proxy/0.log"